SOURCE-LINKED INTELLIGENCE

OpenDiscoveryTrace: Process Traces for Evaluating AI Scientist Workflows

arXiv · AI, language, vision and robotics · article · Sep 5, 2026 · UTC

Existing benchmarks for autonomous AI scientists evaluate only final outputs---generated code, hypotheses, or papers---yet discard the reasoning process by which those outputs were obtained. This makes it impossible to audit scientific methodology, diagnose failure modes, or distinguish systematic reasoning from fortunate guessing. We present \textbf{OpenDiscoveryTrace}, a public dataset of 558 complete AI scientific agent trajectories that captures how models reason, not just what they produce. Each trajectory records a structured 9-field-per-step trace---including thoughts, tool calls, obser

Read original source ↗ Open in workspace

recordType

paper

region

Global