SOURCE-LINKED INTELLIGENCE

LIMBO: Lifelong Inference-Time Memory and Budget Optimization for LLM Agents

arXiv · AI, language, vision and robotics · article · Sep 12, 2026 · UTC

As LLM agents become integrated into increasingly complex workflows, they must continually acquire new capabilities while retaining competence on previously learned tasks. Lifelong agents address this through experience replay, injecting past interactions into the prompt to leverage prior experience during inference. However, replay is not free: every replayed trajectory competes with retrieval, reasoning, tool use, and verification for the same limited prompt and compute budget, making effective resource allocation essential. Existing approaches allocate these resources using fixed replay pol

Read original source ↗ Open in workspace

recordType

paper

region

Global