SOURCE-LINKED INTELLIGENCE

Robust Data-Collection Policy Learning for Low-Variance Online Policy Evaluation

arXiv · AI, language, vision and robotics · article · Aug 25, 2026 · UTC

In reinforcement learning policy evaluation, classic on-policy methods often suffer from high variance when estimating policy performance. To mitigate this issue, behavior policy search has been proposed to learn data-collecting policies tailored to reduce online evaluation variance. However, these approaches do not account for uncertainties in the transition functions. In practice, simulator transitions often differ from the real world due to modeling errors or approximation limitations. As a result, behavior policies trained in simulation may still yield high variance when deployed in real e

Read original source ↗ Open in workspace

recordType

paper

region

Global