arXiv (All)
open access
When Perplexity Lies: Generation-Focused Distillation of Hybrid Sequence Models
Converting a pretrained Transformer into a more efficient hybrid model through distillation offers a promising approach to reducing inference costs. However, achieving high-quality generation in distilled models requires careful joint design of both the student architecture and the distillation proc
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- Data Efficient Any Transformer-to-Mamba Distillation via Attention Bridge#1123958
- D$^3$-MOPD: Dynamic Domain ScheDuling for Efficient Multi-Teacher Distillation#1013669
- Flow-OPD: On-Policy Distillation for Flow Matching Models#172740
- A Quantitative Approximation Framework for Flow Distillation in Diffusion Models#618093
- A Quantitative Approximation Framework for Flow Distillation in Diffusion Models#617593
Record · ID 1013533
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive