Open Question 4.1
Deep linear net dynamics in real networks.
Open Question 4.1: Deep linear net dynamics in real networks. To what extent do deep linear network dynamics (e.g. greedy low-rank progression) carry over to nonlinear networks trained in practice?
This is a discussion page for the open question above. Feel free to share ideas, approaches, or relevant research in the comments below.
Discussion