SOURCE-LINKED INTELLIGENCE

IncentRL: The Trade-Off Between Preference Guidance and Task Performance

arXiv · AI, language, vision and robotics · article · Sep 18, 2026 · UTC

Preference-based reward shaping can guide reinforcement learning, but adding preference signals to the reward may unintentionally change the task being optimized. We address this problem with IncentRL, a framework that introduces preference guidance while explicitly characterizing its effect on external-task performance. IncentRL adds a Kullback--Leibler (KL) penalty between a specified outcome distribution and a preferred distribution. For finite discounted Markov decision processes with bounded shaping costs, we derive an external-value perturbation bound, establish a sufficient strict-actio

Read original source ↗ Open in workspace

recordType

paper

region

Global