SOURCE-LINKED INTELLIGENCE

SIMS: Scale-Invariant Merit-Function-Based Scalarization for Multi-Task Learning

arXiv · AI, language, vision and robotics · article · Sep 11, 2026 · UTC

Multi-task learning (MTL) requires navigating unavoidable trade-offs among competing objectives. This paradigm is frequently formulated as multi-objective optimization (MOO), where the scalarization is favored to reduce an MOO problem to a single objective. We empirically find that existing merit-function-based scalarization approaches are sensitive to the relative scales of different objectives in practical MTL, where task losses commonly differ by orders of magnitude. The optimization process often favors objectives with larger scales even though the underlying Pareto optimal solutions remai

Read original source ↗ Open in workspace

recordType

paper

region

Global