SOURCE-LINKED INTELLIGENCE

(V)LMs generalize beyond surface co-occurrence: Evidence from cross-modal number agreement

arXiv · AI, language, vision and robotics · article · Aug 31, 2026 · UTC

Language models learn about grammatical number primarily from co-occurrence, and show frequency effects as a result---sometimes taken to indicate that they do not learn abstract ``rules'', and are instead dependent on specific lexical items. Testing generalization with text stimuli alone cannot settle this debate, since distributional cues (is/are, this/these) easily give number away. We instead use cross-modal generalization as a tool to investigate abstractions in LMs that can also accept visual inputs (VLMs), restricting the evidence that diagnoses number to an extra-linguistic modality. We

Read original source ↗ Open in workspace

recordType

paper

region

Global