Notes from:

  • Understanding Deep Learning

Some of these notes are also included in Machine Learning.

Foundations

Neural Networks

Shallow Neural Networks

Deep Neural Networks

Loss Functions

Model Fitting/Training

Gradients and Initialization

Model Performance

Learning Theory

Practical

Exercises