Who Did What to Whom? Visually Grounded Role Assignment in Humans but Not in Vision--Language Models

Event role assignment is central to event understanding in both language and vision. Crucially, the foundation of this semantic structure is likely rooted in visual experience. However, it remains unclear whether recent vision–language models (VLMs) can attain this fundamental human cognitive capabi