arXiv (All)
open access
ProteinJEPA: Latent prediction improves protein language model pretraining
Protein language models are trained primarily with masked language modeling (MLM), which predicts masked amino-acid identities. Joint-embedding predictive architectures (JEPA) instead predict latent representations, but have not been applied to proteins. ProteinJEPA supplements MLM with a cosine l
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- English is Not All You Need: Systematically Exploring the Role of Multilinguality in LLM Post-Training#1048631
- Analysis of Quantized and Efficiently Adapted Protein Language Models#1155600
- There is No Theoretical Curse of Multilinguality For Embedding Space Structure#985214
- Cross-lingual brain-language model alignment is robust but challenges hierarchical and computational accounts#998233
- Riemannian Geometry for Pre-trained Language Model Embeddings#1049913
Record · ID 1063909
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive