Whitening Inverts the Hierarchy: What the Norm of a Whitened Embedding Measures

Whitening a foundation-model embedding and using its squared norm as a training-free likelihood surrogate is motivated by the observation that whitened coordinates often appear approximately standard normal. We show that this observation follows from the projection central limit theorem and therefor