arXiv (All)
open access
Do Syntax Heads Influence Model Behavior?
Transformer language models develop attention heads that specialize in syntactic relations, for example, attending from verbs to their subjects. Do these heads play a causal role in the model's syntactic predictions? Evidence for such a role is mixed to negative: even when we force these heads to at
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- Match the Canvas, Not Just the Answer: Predictability-Aware SFT for Diffusion Language Models#1343199
- El uso de razonamientos causales en relación con la significatividad de los modelos teóricos#205281
- LLMs don't know anything: reply to Yildirim and Paul#713460
- The cresting wave: a new moving spotlight theory#753928
- Label Collapse in Diffusion Language Model In-Context Learning#1341722
Record · ID 1345054
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive