RepNN: Tackling spectral bias in deep neural networks for regression and PDE problems via parameter reparameterization

Deep neural networks (DNNs) have achieved remarkable success in scientific computing, yet they often suffer from spectral bias in capturing oscillatory and multiscale behaviors. In this study, we investigate this limitation by examining the failure of shallow ReLU neural networks in fitting high-fre