Invariant Atoms: Sparse Coordinates of Local Semantic Geometry in Language Model Representations

Large language models often preserve meaning despite substantial changes in wording, style, and syntax, while small semantic edits can systematically alter their hidden representations. This suggests that semantic variation may be organized along recurring local directions. We propose the Invariant