B13 A SMALL STEP SIDEWAYS
Several inputs, several rates of change
A network's loss depends on millions of weights at once. Learn how to ask each weight separately "which way, and how fast?", and why the answers form a gradient.
LESSON OVERVIEW9 min lesson
Lesson overview
A network's loss depends on millions of weights at once. Learn how to ask each weight separately "which way, and how fast?", and why the answers form a gradient.
What you’ll explore
- Partial derivatives isolate one input’s local effect; gradients collect scalar sensitivities, while Jacobians organize sensitivities for vector outputs.
GO TO THE SOURCE
Original explanations, connected to the research.
Deep Learning — linear algebraDive into Deep Learning — multivariable calculusSuggest a correction
A precise note can make an explanation better.
Choose the scene and describe what needs attention. Download a feedback file to share through a channel you already use. This page does not send feedback or connect you with a reviewer.