SOURCE-LINKED INTELLIGENCE

Spurious Tool Use: When RL Agents Learn the Wrong Reason to Act

arXiv · AI, language, vision and robotics · article · Sep 14, 2026 · UTC

Large language model (LLM) agents increasingly interleave natural language reasoning with external tools such as web search and code execution. These tool-use policies are often optimized via reinforcement learning (RL), which can amplify spurious correlations in the training data. In this work, we study when and why RL-trained agents learn shortcut tool-selection policies: invoking tools based on superficial prompt cues rather than genuine task requirements. We construct controlled synthetic environments combining factual question answering and mathematical reasoning tasks, and inject cues th

Read original source ↗ Open in workspace

recordType

paper

region

Global