arXiv (All)
open access
WhiFlash: Accelerating Speculative Decoding with Token-Level Cross-Paradigm Routing
The autoregressive nature of large language models (LLMs) remains a significant bottleneck for inference, particularly in complex agentic workloads. While speculative decoding (SD) accelerates inference, current approaches rely on static drafting paradigms, utilising either autoregressive drafting m
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- Efficient Mixture-of-Experts with Speculative Decoding via Expert Coactivation#1037154
- H-Spec: Parallel Speculative Decoding Without a Drafter-Side KV Cache#1050380
- TSS: Target-Side Sparsification for Speculative Decoding in Domain-Specific Large Language Models#1062003
- TIDE: Temporal Incremental Draft Engine for Self-Improving LLM Inference#1076809
- Improving Natural-Language Combinatorial-Optimization Accuracy in Resource-Constrained Language Models via Formal Abstractions#997530
Record · ID 821902
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive