arXiv (All)
open access
STEPQuant: When and Where Errors Matter in Delta-Rule Recurrent State Quantization
Linear attention replaces growing KV caches with fixed-size recurrent states, yet these persistent states can become a substantial memory bottleneck under concurrent serving. Directly quantizing recurrent states to low precision often leads to severe accuracy degradation, as quantization errors prop
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- STEPQuant: When and Where Errors Matter in Delta-Rule Recurrent State Quantization#1122274
- Recency/Frequency Adaptive KV Caching for Large Language Model Serving#299907
- ARC-KV: Amortizing Anchor Search for Reconstruction-Based KV Cache Compaction#1132036
- Complex KDA: Understanding and Enhancing the Expressivity of Kimi Delta Attention#1051198
- Complex KDA: Understanding and Enhancing the Expressivity of Kimi Delta Attention#1028692
Record · ID 1142464
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive