B04 A SMALL STEP SIDEWAYS
Powers and logarithms, one step at a time
A model gave the right word a 1-in-8 chance. How bad is that? Logarithms answer it, and they sit inside every language model's loss and perplexity score.
LESSON OVERVIEW11 min lesson
Lesson overview
A model gave the right word a 1-in-8 chance. How bad is that? Logarithms answer it, and they sit inside every language model's loss and perplexity score.
What you’ll explore
- Evaluate simple powers and logarithms, turn a probability into a loss with −log p, and explain how softmax uses exponentials to turn scores into shares.
Suggest a correction
A precise note can make an explanation better.
Choose the scene and describe what needs attention. Download a feedback file to share through a channel you already use. This page does not send feedback or connect you with a reviewer.