arXiv (All)
open access
Output-Aware Rotation for INT2 KV-Cache Quantization
The key-value (KV) cache has become a major memory and bandwidth bottleneck in long-context large language model inference, making ultra-low-bit quantization increasingly important. However, existing rotation-based INT2 methods optimize cache statistics or proxy errors before the complete attention
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- OSCAR: Offline Spectral Covariance-Aware Rotation for 2-bit KV Cache Quantization#244554
- OSCAR: Offline Spectral Covariance-Aware Rotation for 2-bit KV Cache Quantization#200462
- Recency/Frequency Adaptive KV Caching for Large Language Model Serving#299907
- JustQuant: You Don't Need Smoothing, SVD, or Rotation for 4-Bit Activation Quantization#1118313
- HeadWiseKV: Budgeted Per-Head Cache Residency for Hybrid Long-Context Language Models#822437
Record · ID 1048758
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive