Notes from:
- Understanding Deep Learning
Some of these notes are also included in Machine Learning.
Foundations
Neural Networks
Shallow Neural Networks
Deep Neural Networks
Loss Functions
- Loss Function
- Conditional Probabilistic Perspective of Learning
- Maximum Likelihood Criterion
- Log-Likelihood Criterion
- Loss Function Recipe
- Cross-Entropy Loss
Model Fitting/Training
Gradients and Initialization
- Backpropagation Intuition
- Backpropagation Algorithm
- Backpropagation Scalar Example
- Backpropagation 3-Layer Example
- Parameter Initialization