arXiv (All)
open access
Libra: Taming Attention Workload Skew in Long-Context LLM Training with Bounded Sequence Pool
Long-context LLM training suffers from a load-balancing problem that sequence packing does not solve. Packing samples into fixed-token sequences balances memory and linear-cost operators, but the dominant attention cost scales with the sum of squared sequence lengths. Thus, equally sized packed sequ
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- Libra: Taming Attention Workload Skew in Long-Context LLM Training with Bounded Sequence Pool#405615
- Effects of bimodal divided attention on cortical representations of linguistic context during continuous speech perception in noise#241458
- Does active sampling prevent textual degradation in recursive training?#654783
- LeapQuant: Efficient Linear Attention with Accurate Recurrent State Quantization#1142461
- LeapQuant: Efficient Linear Attention with Accurate Recurrent State Quantization#1122275
Record · ID 1014774
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive