ClassroomThe classroom
Back to the lesson libraryMATH SIDE LESSON
B16 A SMALL STEP SIDEWAYS

Choose a direction and a step size

A learning rate of 0.5 finishes in one step; 1.1 flings the weight off to infinity. See why, using one bowl-shaped loss and a formula you can check by hand.

LESSON OVERVIEW9 min lesson

Lesson overview

A learning rate of 0.5 finishes in one step; 1.1 flings the weight off to infinity. See why, using one bowl-shaped loss and a formula you can check by hand.

What you’ll explore

  • Optimization combines an objective, feasible choices, and an update rule; curvature, constraints, and momentum affect which steps are useful.
GO TO THE SOURCE

Original explanations, connected to the research.

Deep Learning — numerical computation
Suggest a correction

A precise note can make an explanation better.

Choose the scene and describe what needs attention. Download a feedback file to share through a channel you already use. This page does not send feedback or connect you with a reviewer.

The file includes this note, the scene title, and lesson metadata. Your saved progress and quiz responses are excluded. Download before leaving or reloading to keep your note.