Deep Learning

Notes from:

• Understanding Deep Learning.
• Alice’s Adventures in a Differentiable Wonderland — Volume I, A Tour of the Land

Most of these notes are also included in Machine Learning.

Foundations

• Tensor
• Einstein Notation

Shallow Neural Networks

• Shallow Neural Network
• Universal Approximation Theorem
• Multivariate Inputs and Outputs for Neural Networks

Deep Neural Networks