KVMem
arXiv 2026 · Open sourceVirtualizes million-token agent workspaces on a consumer GPU, keeping history as reusable KV blocks and retrieving only the context needed for each step.
Research insight
The paper separates the persistent KV workspace from the model's active context window. Query-conditioned retrieval selects relevant historical blocks and assembles a bounded execution view, reusing previously computed KV state instead of repeatedly prefilling recalled text.