Not All Rollouts Are Worth Learning: On Trajectory Valuation for Post-Training Reinforcement Learning

We consider the problem of trajectory valuation in reinforcement learning: how to identify and mitigate detrimental trajectories during online training. Unlike classification, where data valuation relies on fixed training and validation sets, reinforcement learning involves dynamically generated tra