ClassroomThe classroom
Back to the lesson libraryMATH SIDE LESSON
B11 A SMALL STEP SIDEWAYS

What can a small experiment tell us?

Your model scores 80% on 100 test questions. Is the real number 79%, or 70%? Learn to put an honest error bar on a score, and read it correctly.

LESSON OVERVIEW10 min lesson

Lesson overview

Your model scores 80% on 100 test questions. Is the real number 79%, or 70%? Learn to put an honest error bar on a score, and read it correctly.

What you’ll explore

  • Estimates and uncertainty intervals depend on sampling assumptions; hypothesis tests, bootstrap estimates, and multiple-comparison controls answer different questions.
GO TO THE SOURCE

Original explanations, connected to the research.

An Introduction to Statistical Learning — authors’ materials
Suggest a correction

A precise note can make an explanation better.

Choose the scene and describe what needs attention. Download a feedback file to share through a channel you already use. This page does not send feedback or connect you with a reviewer.

The file includes this note, the scene title, and lesson metadata. Your saved progress and quiz responses are excluded. Download before leaving or reloading to keep your note.