arXiv (All)
open access
LightMTP: Lightweight Latent Multi-Token Prediction
Next-token prediction (NTP) is the standard pretraining objective for large language models, yet it provides an explicit training signal only for the immediate next token, which can lead models to exploit local patterns instead of capturing longer-range structure and ideas. Multi-token prediction (M
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- Training LLMs Beyond Next Token Prediction - Filling the Mutual Information Gap#1342357
- Parameter-Efficient Adaptation of Pretrained Language Models for Time-Series Forecasting#1109368
- Textual Planning with Explicit Latent Transitions#1156273
- TurboMamba: Faster Inference, Faster Training, and Better Prediction with Lexical Memory#1355671
- SemBridge: Semantic Token Anchoring for Continuous-Latent Autoregressive Speech Generation#1341504
Record · ID 1202450
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive