SOURCE-LINKED INTELLIGENCE

Which one is banana man? Evaluating vision-language models in multi-turn pragmatic interpretation

arXiv · AI, language, vision and robotics · article · Aug 30, 2026 · UTC

Flexible adaptation to context and shared pragmatic intuitions contribute to smooth human conversation. Iterated reference games---in which players repeatedly pick out novel referents using language---present a test case for agents' ability to perform context-sensitive pragmatic reasoning in multi-turn linguistic environments. We tested humans and vision--language models on their ability to identify the intended meaning of descriptions produced in iterated reference games, varying the provided context in terms of amount, order, and relevance. While humans performed well consistently, the model

Read original source ↗ Open in workspace

recordType

paper

region

Global