Successful but Unsafe: An Analytical Benchmark for Revealing Collisions in Vision-and-Language Navigation

Vision-and-language navigation (VLN) agents are typically evaluated by whether they reach a target and how efficiently they follow an instructed route, yet these metrics provide little information about collision behavior. Moreover, continuous VLN evaluation commonly uses a sliding regime, where an