A Systematic Comparison of Multilingual Interpretability Methods Reveals Anisotropy-Driven Failures

Multilingual language models develop shared cross-lingual representations, and various interpretability methods claim to quantify this sharing. These methods have been developed largely in isolation, and when they disagree, it is unclear whether the disagreement reflects a property of the model or a