SOURCE-LINKED INTELLIGENCE

The Answer Is Not the Argument

arXiv · AI, language, vision and robotics · article · Aug 31, 2026 · UTC

Chain-of-thought monitoring is proposed for AI oversight, yet evaluations often provide monitors with a trusted reference answer. We ask whether answer access improves reasoning verification or mainly exposes incorrect conclusions. We collected 237 step-numbered solutions to 79 Humanity's Last Exam physics questions from three frontier models, with no inserted errors, and independently labelled final-answer correctness and the first false step. The reference standard combined physicist annotations, an independent LLM debate, and source-masked adjudication. This yielded 24 critical traces in wh

Read original source ↗ Open in workspace

recordType

paper

region

Global