M10.2 CONNECT THE MECHANISM
Check a derivative against a small change
Your model trains, nothing crashes, and the loss still won't fall. Learn the ten-line test that catches a wrong gradient before it wastes a week.
LESSON OVERVIEW11 min lesson
Lesson overview
Your model trains, nothing crashes, and the loss still won't fall. Learn the ten-line test that catches a wrong gradient before it wastes a week.
What you’ll explore
- Finite differences approximate local sensitivity and can check analytic or automatic gradients, with tradeoffs from step size, rounding, and nondifferentiable points.
GO TO THE SOURCE
Original explanations, connected to the research.
Deep Learning — numerical computationDive into Deep Learning — authors’ open textbookSuggest a correction
A precise note can make an explanation better.
Choose the scene and describe what needs attention. Download a feedback file to share through a channel you already use. This page does not send feedback or connect you with a reviewer.