Zhen Tan

Constraint Unlearnability in Overparameterized Neural Networks

We study whether overparameterized neural networks can learn to satisfy pointwise constraints without inductive bias. One might expect that a sufficiently expressive network would learn to respect such constraints. We prove that this is not the case. For overparameterized feedfor...