Hacking or Just Failing? A More Capable LLM Monitor Better Separates Reward Hacking from Honest Failure

An agent's visible score can exceed its real progress because it gamed the score or because it simply made mistakes, so a useful reward-hacking monitor must tell the two apart. We built a sandboxed task in which an agent can game a completion score, labelled every episode by replaying it and repairi