SOURCE-LINKED INTELLIGENCE

Granularity-Adaptive Credit Assignment for Long-Horizon LLM Agent Reinforcement Learning

arXiv · AI, language, vision and robotics · article · Sep 11, 2026 · UTC

Reinforcement learning is now the standard way to train large language model agents on long-horizon tasks, where dozens of interdependent actions precede a single sparse reward. Critic-free, group-relative methods such as GRPO suit this regime, but they broadcast one trajectory-level scalar to every step and cannot say which decision drove the outcome. GiGPO recovers a step-level signal by grouping time steps that share an anchor state, yet it merges the step- and episode-level estimates under one fixed weight, spending the same resolution on a pivotal branching decision as on a routine, near-

Read original source ↗ Open in workspace

recordType

paper

region

Global