arXiv (All)
open access
Variational-Ising-Attention:Tailored Attention Matters for Science
Attention enables context modeling via query-key scoring with softmax normalization. Driven by industrial long-context demands, mainstream research has converged toward sparsity and efficiency, yet softmax's independence assumption persists. For scientific tasks unburdened by long-token constraints,
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- Spatial Attention Noise Masking for Causally Sufficient Interpretability#609158
- SparseBalance: Load-Balanced Long Context Training with Dynamic Sparse Attention#14041
- SAS: Simple Attention Sparsification via End-to-End Optimization of Context Ranking#823866
- Language Models Can Control Their Own Attention#924873
- Language Models Can Control Their Own Attention#920639
Record · ID 1216369
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive