Quickstart Guide: Places to make a difference


[TO BE WRITTEN]


A Quickstart Guide to Learning Mechanics

  1. Introduction: asking a specific question
  2. The average size of hidden representations
  3. Hyperparameter selection (and why theorists should care)
  4. The dynamics of optimization
  5. 🚧 Feature learning and the final network weights
  6. 🚧 Generalization
  7. 🚧 Neuron-level sparsity
  8. 🚧 The structure in the data
  9. 🚧 Places to make a difference

Comments