EigDiff: Eigensample Diffusion - or how to significantly reduce training dataset size with marginal performance variation?

Diffusion models are notoriously expensive to train, requiring large-scale datasets to learn how to gradually reverse the noise from images over multiple small denoising steps. Current approaches focus on distilling the number of diffusion steps, neglecting potential redundancies of the training dat