arXiv (OAI Expanded)
open access
AgentKV: Phase-Aware KV Eviction for Agentic LLMs
Agentic serving can consume orders of magnitude more tokens than chatbot workloads, stressing both KV-cache capacity and decode-time bandwidth. Most KV-eviction methods score cached keys against representative queries drawn from the most recent tokens, assuming future attention resembles recent atte
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- ATTUNER: Recomputation-Free KV Cache Reuse via Query-Side Adaptation#1131923
- CacheWise: Understanding Workloads and Optimizing KVCache Management for Efficiently Serving LLM Coding Agents#280159
- TokenCake: A KV-Cache-centric Serving Framework for LLM-based Multi-Agent Applications#662379
- TokenCake: A KV-Cache-centric Serving Framework for LLM-based Multi-Agent Applications#661329
- Tools-CC-Bench: a Benchmark Suite for Collective Communication with Compression in HPC and AI Workloads#1083219
Record · ID 1084785
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive