SOURCE-LINKED INTELLIGENCE

Learning Heterogeneous Preferences

arXiv · AI, language, vision and robotics · article · Sep 15, 2026 · UTC

Learning from human feedback has become a central paradigm for training modern AI systems, where models of human utility are used as reward models in policy learning. Existing methods typically assume a \emph{universal utility} function shared across a population and treat disagreement between annotators as stochastic variation. While suitable for objective tasks, this assumption breaks down in subjective domains where preferences vary systematically across individuals. We study the problem of subjective preference learning, in which observed choices arise from heterogeneous but internally con

Read original source ↗ Open in workspace

recordType

paper

region

Global