AMATH 449 - Neural Networks

Course Info

• Final: Friday, April 17, 4:00pm - 6:30pm

Notes

Biological Networks

• Hodgkin-Huxley Neuron Model
• Leaky Integrate-and-Fire Model
• Simple Neuron Activation Functions
• Synapses

Basics

• Automatic Differentiation
  • Neural Network with Autodiff
• Human Visual System

Unsupervised Learning

• Hopfield Networks
• Restricted Boltzmann Machines
  • RBM Intuition
• Autoencoder
• Vector Embeddings
• Variational Autoencoder

Recurrent Neural Networks

• Recurrent Neural Networks
• Long Term Short Memory
• Gated Recurrent Unit
• Adversarial Attacks
• Adversarial Defence

Neural Engineering

• Neural Engineering
• Population Coding
• Population Coding Transformations
• Population Coding Dynamics
• Learning Decoders

Additional Topics

• Generative Adversarial Networks
• Predictive Coding
• Transformer Summary