SOURCE-LINKED INTELLIGENCE

Locating Hidden Failures Makes Long-Horizon Agents More Reliable

arXiv · AI, language, vision and robotics · article · Sep 15, 2026 · UTC

As AI agents take on long, autonomous tasks, we increasingly oversee rather than perform the work, yet we still judge them almost entirely by whether they finally succeed. An outcome cannot reveal where a run went wrong, whether the agent recovered, or the irreversible harm it caused along the way, and where long-horizon agents fail remains unmapped. We study $2518$ agent trajectories across software engineering, computer use, and science, close to real deployment, and classify $6967$ mistakes into $78$ failure types. Failure follows a recurring signature: after its first mistake an agent ofte

Read original source ↗ Open in workspace

recordType

paper

region

Global