SOURCE-LINKED INTELLIGENCE

The widening evaluation gap in medical large language model research 2023 to 2026

arXiv · AI, language, vision and robotics · article · Sep 10, 2026 · UTC

Large language models are superseded every few quarters; clinical evidence takes years. We asked whether medical research is keeping pace with the systems it evaluates. PubMed returned 11,628 records for January 2023 to June 2026 across fourteen clinical domains, growing 45-fold; 2.5% used a randomised, controlled or prospective design. Evaluation lag, from a study's newest named model release to its own publication, widened from 1.33 to 6.08 quarters. Because discontinued models age mechanically, we benchmarked this against a counterfactual holding model composition fixed: migration to newer

Read original source ↗ Open in workspace

recordType

paper

region

Global