Skip to content

Overparametrized Neural Networks

Definition

A neural network where the number of parameters far exceeds the number of training samples.

This means there are infinitely many solutions that can achieve really low training error.

References

Neural Networks