SOURCE-LINKED INTELLIGENCE

Two-Token Features and Small-Large Ensembles for VLM Hallucination Detection

arXiv · AI, language, vision and robotics · article · Sep 9, 2026 · UTC

We present our system for the SHROOM-Visions 2026 shared task on character-level VLM hallucination detection. A small ($4$B-parameter) VLM is fine-tuned as a per-token classifier reading a two-token feature from its own hidden states, and is ensembled with a $\sim$400B zero-shot VLM judge at prediction time. Both components see off-the-shelf OCR of any visible in-image text. We use synthetic hallucination data generated by the large model as a source of ensemble diversity, and use validation to select feature layer, training data and OCR grounding. Our official entry reaches mean Cor $0.487$ /

Read original source ↗ Open in workspace

recordType

paper

region

Global