SOURCE-LINKED INTELLIGENCE

MedRoundsQA: A Persona and Difficulty Aware Evaluation for Multi-Turn Medical Consultations

arXiv · AI, language, vision and robotics · article · Sep 11, 2026 · UTC

Medical benchmarks are dominated by single-turn, multiple-choice clinical cases that poorly reflect real consultations. Practically, clinicians elicit evidence interactively and patient communication varies widely. We introduce MedRoundsQA, a multi-turn diagnostic benchmark derived from 1,387 board-exam cases across 17 specialties. Each case is converted into a structured 24-slot clinical record, and then instantiated as controlled doctor-patient dual-agent dialogues under varying patient personas, with the underlying clinical content held fixed. We further classify cases by difficulty using m

Read original source ↗ Open in workspace

recordType

paper

region

Global