Minigame
Python
Beginner
25 min
Gradient descent step size and momentum: roll a ball down a narrow valley
Afterwards you can explain why gradient descent diverges above a step size of 2/L, why it crawls in narrow valleys, even a line fit's, and how momentum helps.
Optimization
Cross-disciplinary