arXiv (All)
open access
TokenGate: Adapting LLMs for Fast and Memory-Efficient Prefill with Learned Token Pruning
Expert human readers process large inputs (e.g., code repositories and long documents) by skimming to closely read only what matters. On the other hand, language models process all input tokens through each model layer, resulting in significant processing costs for long-context inputs. We introduce
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- TokenGate: Adapting LLMs for Fast and Memory-Efficient Prefill with Learned Token Pruning#1381278
- SAGE: Selective Attention-Guided Extraction for Token-Efficient#31352
- FLEET: From Logits Entropy to Enhanced Trajectories in Text Generation#1064201
- Riemannian Graph Tokenizer for Structural Knowledge Transfer#1326677
- How Should Diffusion Language Models Edit Code?#1142858
Record · ID 1402005
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive