SOURCE-LINKED INTELLIGENCE

VRL-Bench: Benchmarking agents on computer control tasks under finite trial budgets

arXiv · AI, language, vision and robotics · article · Sep 11, 2026 · UTC

Learning from trial and error is a promising way to improve language agents on complex tasks such as computer control. Reflexion introduced verbal reinforcement learning, which turns failed trials into text that guides later attempts without updating model parameters. We introduce VRL-Bench, a harness for fair evaluation of trial-and-error learning under finite trial budgets. Across three models on MiniWoB and WebShop, we evaluate updates from several prominent verbal-memory methods spanning Reflexion and later work: each improves observed success over memory-free retry in some settings but re

Read original source ↗ Open in workspace

recordType

paper

region

Global