From Privacy to Generalization: Linear Max-Information Bounds for Differentially Private Learning Algorithms

Understanding the relationship between generalization and privacy remains a challenge in modern machine learning theory, particularly for deep networks that are trained by variants of differentially private stochastic gradient descent (DP- SGD). In this work we make progress on this persistent open