Can I Buy Your KV Cache? (arxiv.org) AI

The arXiv paper “Can I Buy Your KV Cache?” proposes that publishers precompute and sell a model’s key-value (KV) cache for documents so agents can skip repeated, compute-heavy “prefill,” while claiming token-exact reuse with no accuracy loss; it argues compute savings can outweigh KV shipping costs if the cache is hosted server-side like prompt-caching.