AIIC AI Intelligence Centre

SOURCE-LINKED INTELLIGENCE

Representation Measurements Under Function-Preserving Reparameterizations

arXiv · AI, language, vision and robotics · article · Aug 27, 2026 · UTC

Hidden coordinates are not uniquely determined by a language model's input--output function, so representation-derived measurements should be invariant to function-preserving changes of basis. This study shows that column-permutation parallel analysis violates function-preserving reparameterization invariance because its reference distribution and selected component count can change while the model function and observed covariance spectrum remain fixed. More generally, a data-internal reference procedure cannot simultaneously preserve every coordinate marginal, remain orthogonally equivariant,

Read original source ↗ Open in workspace

recordType
paper
region
Global

Evidence & attribution

First collected: 2026-09-21T08:51:59.673Z. This is not the publication date.