arXiv (All)
open access
Block-Sparse Attention with Semantic-Geometric Decoupled Routing
Long-context inference has become a defining capability of large language models, but exact dense attention remains costly due to its quadratic scaling with sequence length. Block-sparse attention offers a hardware-friendly alternative by routing each query block to a small set of relevant key block
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- Elastic Threshold Attention: Learned Contextual Sparsity for Long-Context Decoding#1034862
- Attention and memory#695312
- Gathered, Not Admitted: How Attention Brings a Latent Variable into Verbalizable Form#612453
- Gathered, Not Admitted: How Attention Brings a Latent Variable into Verbalizable Form#610976
- Stochastic Sparse Attention for Memory-Bound Inference#155250
Record · ID 1037567
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive