Do Agent Benchmarks Do What They Say? An Executable-Contract Audit of Tool-Using Agent Environments

Tool-using agents are entering settings where a wrong action carries real cost, and the benchmarks certifying them grade what each simulated tool call reports having done, assuming the tool did what its interface advertises. The audit taxonomies we survey publish no category for that assumption, and