Support or Magnitude? Characterizing Neuron Relevance for Instruction Data Selection

Model-internal signals, such as neuron activations and gradients, have been used for instruction data selection, yet how neuron relevance should be characterized remains underexplored. In particular, should selection prioritize the magnitude of relevance or how broadly it is distributed across neuro