arXiv (OAI Expanded)
open access
Data Efficient Any Transformer-to-Mamba Distillation via Attention Bridge
State-space models (SSMs) have emerged as promising alternatives to Transformers for sequence modeling. However, training competitive SSMs from scratch remains computationally intensive, and the ecosystem around them is far less mature than that of Transformers. Moreover, the architectural differenc
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- When Perplexity Lies: Generation-Focused Distillation of Hybrid Sequence Models#1013533
- Beyond Sequence Order: Syntax-Informed Positional Embeddings for Transformers#432586
- Official Review · ICLR 2025#787185
- Official Review · ICLR 2026#787143
- Pumping Optimization of Coastal Aquifers using 3-D Density Models and Approximations with Neural Networks#640946
Record · ID 1123958
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive