SOURCE-LINKED INTELLIGENCE

Sharp Rates and a One-Line Correction for Spectral Representation Learning

arXiv · AI, language, vision and robotics · article · Sep 14, 2026 · UTC

A self-supervised encoder is trained once, frozen, and reused through lightweight probes on tasks nobody named at training time; the practitioner's question is when the off-the-shelf features are good enough and when they need fixing. Canonical correlation analysis, HGR maximal correlation, and the population optimum of the spectral contrastive loss all return the top-$k$ singular subspace of a cross-view dependence operator, justified by isotropy: if the task prior has no directional preference, that subspace is universally optimal. We show isotropy is the wrong hypothesis. The prior enters t

Read original source ↗ Open in workspace

recordType

paper

region

Global