arXiv (All)
open access
COPC: Coupled Off-Policy Correction for Asynchronous LLM Reinforcement Learning
Asynchronous RL accelerates large language model post-training by decoupling rollout generation from optimization, but trains on stale trajectories. Existing methods primarily correct token-level policy mismatch through importance-ratio control in the actor objective. We show that this \emph{policy-
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- BRACE: Anchored Bellman-Residual Correction for Stale Critics in Asynchronous RL#1110351
- ReSPO: Reshaped Sequence Policy Optimization for Gradient Starvation in Off-Policy Learning#1130021
- Rollout Total Correlation for Deep Reinforcement Learning#1034623
- ECHO-2: A Large-Scale Distributed Rollout Framework for Cost-Efficient Reinforcement Learning#1131454
- Decision Titan: Test-Time Training for Long-Term Memory in Offline Reinforcement Learning#1156785
Record · ID 1233965
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive