Open Question 2.3
Framework for studying feature learning at large width and depth.
Open Question 2.3: Framework for studying feature learning at large width and depth. Is there a simple, computationally tractable calculational framework — potentially making realistic simplifying assumptions — that allows us to quantitatively study the feature evolution of an infinite-depth network in the rich regime?
This is a discussion page for the open question above. Feel free to share ideas, approaches, or relevant research in the comments below.
Discussion