SOURCE-LINKED INTELLIGENCE

From Vision to Language: Investigating Causal Information Flow in Multimodal Decision-Making

arXiv · AI, language, vision and robotics · article · Sep 4, 2026 · UTC

Vision-Language Models are commonly evaluated through their final predictions, but understanding whether these decisions are grounded in visual evidence requires tracing how visual information contributes to language-based decisions. With this purpose in mind, we investigate cross-modal information flow in a video-based generative multiple-choice-like setting by applying a layer-wise causal intervention on video-text attention pathways. We target spatial, causal, and temporal visual reasoning. Our results show that visual information is mainly integrated while the model processes the candidate

Read original source ↗ Open in workspace

recordType

paper

region

Global