arXiv (All)
open access
KVCompass: A Discovery Plane for Internet-Scale Prefix Cache Sharing in LLM Serving
KV cache reuse is one of the most effective ways to reduce LLM inference cost, but today its benefits are largely confined to a single cluster. When a provider serves the same model across geographically distributed regions, each region may repeatedly prefill the same popular prefixes, wasting GPU t
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- KVCompass: A Discovery Plane for Internet-Scale Prefix Cache Sharing in LLM Serving#1381217
- Same Request, Different Answer: Quantization Amplifies Cache-Induced Divergence in LLM Serving#971420
- SoftCache: Adaptive Step Size Caching for Diffusion Transformers#1358024
- Where Activation Sparsity and KV-Cache Sparsity Cross in LLM Decoding#1118962
- An Internet for the KV Cache: Rethinking Classical Infrastructure Boundaries in the LLM Inference Age#423899
Record · ID 1388745
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive