SOURCE-LINKED INTELLIGENCE

Is Monte Carlo Tree Search Just Every-Visit Monte Carlo Control?

arXiv · AI, language, vision and robotics · article · Aug 28, 2026 · UTC

Monte Carlo Tree Search (MCTS) and every-visit Monte Carlo (MC) control are usually presented as different methods. MCTS is described in the language of search (selection, expansion, simulation, and backup), whereas MC control is described in the language of reinforcement learning (trajectory sampling, return estimation, action-value updating, and policy improvement). This note argues that, at the level of trajectory generation and action-value updating, the distinction is largely terminological. The tree policy and rollout policy can be viewed as the learned and not-yet-learned parts of a sin

Read original source ↗ Open in workspace

recordType

paper

region

Global