SOURCE-LINKED INTELLIGENCE

Prevalence Determines Precision:Silent Contamination in Detector-Defined Datasets

arXiv · AI, language, vision and robotics · article · Sep 10, 2026 · UTC

Many ML datasets are constructed by running a detector, heuristic, or model over candidate pools; accepted items become labels. Dataset precision is then governed by true-positive prevalence in each pool via Bayes, not solely by detector quality. Using one instrument and period, we hold a detector-defined event dataset plus an independent official index labeling every detected item as real or phantom. One detector, three pools yield phantom rates 81.7%, 9.0%, and 0.0%. Transferring precision from the two high-rate pools to the low-rate pool predicts 0.955 versus measured 0.183, a +422% error;

Read original source ↗ Open in workspace

recordType

paper

region

Global