SOURCE-LINKED INTELLIGENCE

How Many Labels Does Model Choice Need? Certificates and Budgets for Selective Prediction

arXiv · AI, language, vision and robotics · article · Sep 16, 2026 · UTC

Classifiers can make identical predictions yet require labels to compare their selective performance: confidence ranks weight the same errors differently. We quantify this requirement for the area under the generalized risk-coverage curve (AUGRC). A prelabel lower bound rules out insufficient budgets. With all labels known, a covering linear program bounds the minimum number of labels sufficient to fix the winner (the certificate size) within $K-1$ labels for $K$ candidates. For fixed $K$, independent uniform orders and identical predictions, the prelabel bound approaches one quarter of the po

Read original source ↗ Open in workspace

recordType

paper

region

Global