SOURCE-LINKED INTELLIGENCE

SCQ: Stabilizing Conservative Q-Learning with Sigmoid-Bounded Entropy

arXiv · AI, language, vision and robotics · article · Sep 11, 2026 · UTC

Offline-to-online reinforcement learning reduces interaction cost for real-world robot learning but suffers from persistent value estimation instability. Existing methods address this through pessimistic regularization, lower-bound calibration, and architectural normalization, but an overlooked source of instability lies in the entropy formulation: the standard log-entropy term can become negative, destabilizing policy updates. We introduce SCQ (Sigmoid-Bounded Conservative Q-Learning), which replaces this term with a sigmoid-bounded formulation that stays strictly positive. SCQ retains conser

Read original source ↗ Open in workspace

recordType

paper

region

Global