SOURCE-LINKED INTELLIGENCE

Beyond Majority Vote: Multi-Perspective Adjudication for Medical Hallucination Detection

arXiv · AI, language, vision and robotics · article · Sep 3, 2026 · UTC

Understanding the frequency of factual errors in chatbot-generated text and evaluating systems that detect these errors is critical for determining chatbot safety. Yet factual-error detection is often treated as a single-pass, single-annotator labeling problem. In long-form chatbot responses, factual errors can be subtle and embedded within mostly correct text. We develop a multi-perspective annotation study of medically relevant chatbot responses, combining first-pass annotation, LLM-as-a-Judge (LaJ) candidate discovery, and two forms of adjudication: medical-expert and evidence-based fact-ch

Read original source ↗ Open in workspace

recordType

paper

region

Global