AIIC AI Intelligence Centre

SOURCE-LINKED INTELLIGENCE

Closing the Consistency Gap: Self-Evolving Agents That Learn to Stay on Course

arXiv · AI, language, vision and robotics · article · Sep 8, 2026 · UTC

Large language model (LLM)-powered agents can be accurate on average yet unreliable in production, a discrepancy that has been observed but remains largely unaddressed. When given the same task five times, a ReAct agent on the AppWorld benchmark using GPT-4.1 succeeds in all five runs only 53% of the time, even though its per-run pass rate averages 77%. We call this 24-point shortfall the consistency gap, and we argue that addressing it is a precondition for trustworthy AI agent deployment. We present a self-evolving agent framework that reduces this gap by identifying unstable, low-consistenc

Read original source ↗ Open in workspace

recordType
paper
region
Global

Evidence & attribution

First collected: 2026-09-20T20:02:11.508Z. This is not the publication date.