Learning Structured Sparsity for Large Models: Bridging Model Compressibility and Efficient Inference

Scaling laws continue to reward increases in model scale, while the resulting computational and memory demands drive greater reliance on cloud infrastructure for inference. Yet unreliable network connectivity, communication delays, and privacy requirements can make such reliance impractical, motivat