/notes/

Recent

  • Backpropagation Algorithm

    Jul 15, 2025

    • dl
  • Backpropagation Intuition

    Jul 14, 2025

    • dl
  • Backpropagation Toy Example

    Jul 14, 2025

    • dl

See 1410 more →

Home

❯

ML

❯

Optimizing Neural Networks

Optimizing Neural Networks

Jan 28, 20241 min read

  • ml
  • Adaptive step-size
    • Running Averages
    • Momentum (ML)
    • Adadelta
    • Adaptive moment estimation

Graph View

Created with Quartz v4.4.0 © 2025

  • Main Website
  • GitHub
  • LinkedIn