Neural Spectral Capacity with Residual Context for Heterogeneous Resource Allocation within Transformers

Predicting relative trained performance from architectural specifications can guide design when training costs limit experimentation. Neural Spectral Capacity (NSC) provides such a heuristic, but scores projections independently and assigns identical scores to compatible reorderings of the same laye