SOURCE-LINKED INTELLIGENCE

Fabrication After Tool Failure: Tool-Augmented Agents Assert Values Their Tools Did Not Return

arXiv · AI, language, vision and robotics · article · Sep 13, 2026 · UTC

Tool-augmented language models are evaluated on whether they reach the right answer, not on whether they report honestly when a tool fails to supply one. We isolate this post-failure decision with a benchmark of 1,024 items spanning 16 internal-system domains and eight tool-failure types, in which a tool call is enforced and the returned payload is guaranteed to be unusable. Under a deployment-style system prompt, 14.10% of responses are dishonest: the model either asserts a value the payload cannot support or declines while citing a fabricated policy or capability limit. The rate is governed

Read original source ↗ Open in workspace

recordType

paper

region

Global