IoU-PD: IoU-Aware Privileged Distillation for Visual Grounding with Multimodal Large Language Models

Visual grounding with multimodal large language models is commonly formulated as autoregressive coordinate generation, where a model outputs bounding-box coordinates as text given an image and a referring-expression prompt. While this interface is simple and compatible with instruction following, it