arXiv (All)
open access
An Active-Bottleneck Mechanism for Weak-to-Strong Generalization
Weak-to-strong generalization (W2SG) occurs when a student trained on a teacher's predictions outperforms that teacher. We study when this happens under fully converged, ridgeless two-stage learning, with no early stopping, no explicit regularization, and no assumption that the student is more expre
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- Understanding Off- vs On-Policy Distillation: A Tale of Distinct Training Objectives#1143267
- Not All Forgetting Is Equal: Architecture-Dependent Retention Dynamics in Fine-Tuned Image Classifiers#10363
- A Theoretical Analysis of Generalization Dynamics in Neural Networks under Gradient Descent with Weight Decay#984655
- Eliciting Weak-to-Strong Generalization with On-Policy Reverse Distillation#986431
- Data-free On-policy Distillation#1136554
Record · ID 1118908
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive