Which Self-Improvements Should We Trust? Reliable Self-Improvement When Agents Reuse Their Benchmarks

As recursive self-improvement (RSI) rapidly advances, reliable evaluation becomes critical for guiding adaptive search. RSI typically relies on finite evaluation resources, such as fixed benchmarks, to determine which modifications are retained and what is proposed next. However, when these finite r