arXiv (All)
open access
Towards Understanding Momentum Acceleration in River-Valley Loss Landscape
The empirical success of pretraining large language models has inspired a deeper investigation into the underlying loss landscapes and the optimization dynamics. Recent empirical and theoretical study suggest that the training loss landscape often exhibits a "river-valley" structure, which features
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- Apparent Psychological Profiles of Large Language Models are Largely a Measurement Artifact#290636
- Delta-Matching: Closing the Final Gap of Native 8-bit Training for LLMs#1142160
- Why Pretraining Fails to Share Cross-Lingual Knowledge#1013889
- The Answer-Basin Representation Hypothesis: We Are Not Probing or Steering Concepts#1051220
- SpecQuant: Speculative Decoding with Multi-Parent Quantization for Adaptive LLM Inference#1036094
Record · ID 1105516
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive