SOURCE-LINKED INTELLIGENCE

ModaLens: Measuring Image Sensitivity in Report-Conditioned Medical VLMs

arXiv · AI, language, vision and robotics · article · Sep 14, 2026 · UTC

A radiology report can already answer a clinical question, so it is hard to tell whether a vision-language model also uses the image. ModaLens, a paired image-swap audit, measures how report availability changes image sensitivity: MedGemma-27B on 3,199 paired MIMIC-CXR cases from 293 patients, all 14 questions per case (13 finding-specific and one composite), each image replaced by one from another study, usually of the same patient, with question and report fixed. Under an explicit answer instruction, the model's generated answer changes on 4.26 percent of trials with the report and 20.94 per

Read original source ↗ Open in workspace

recordType

paper

region

Global