Forty Shades of Blue: Quality-Diversity Alignment via Mode-Conditioned Reinforcement Learning

A notable byproduct of LLM alignment training is mode collapse: the progressive loss of output diversity that narrows a model's expressivity at inference time. This degradation is especially limiting for applications requiring open-ended exploration and pluralistic perspectives, such as scientific i