arXiv (All)
open access
Generalization Dynamics of LM Pre-training
People typically assume that LMs stably mature from pattern-matching parrots to generalizable intelligence during pre-training. We build a toy eval suite and show this mental model is wrong: throughout pre-training, LMs frequently and suddenly hop between parrot-like and intelligence-like computatio
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- Continuity of Cognition: The Dolittle Sandbox for Cross-Substrate Observation and Action Coupling#90957
- Preactivation and probabilistic inference coexist during sentence comprehension#361036
- Language is a super-attractor: Does it evolve through subjective selection?#690833
- Mistaking Covariance for Combination in Sensorimotor Adaptation: Regression Slopes Do Not Test Additivity.#209647
- Mindshaping and Active Inference#105393
Record · ID 1117862
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive