Pietro Rotondo

Proportional infinite-width infinite-depth limit for deep linear neural networks

In this paper, we study the distributional properties of linear neural networks with random parameters in the context of large networks, where the number of layers diverges in proportion to the number of neurons per layer. Prior works have shown that in the infinite-width regime,...