arXiv (All)
open access
Mid-Training Language Models on Raw Video
Multimodal large language models learn mostly from paired image-text data or annotated video, and raw web video is rarely used to further train an existing language model. We study whether raw video, with no captions and no text loss, can serve as mid-training data for a pretrained language model. F
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- Advancing Video-Text Pretraining with Multi-View Captions#1129691
- Video Codec-Guided Training-Free Token Compression for Video Large Language Models#1297311
- MARS: What Retrieval Signals Are Hidden in Multimodal Large Language Models for Text-Video Retrieval?#924722
- MARS: What Retrieval Signals Are Hidden in Multimodal Large Language Models for Text-Video Retrieval?#920488
- Visual Token Coding for Video Multimodal Large Language Models#784778
Record · ID 1247946
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive