M21.1 CONNECT THE MECHANISM
Separate a correct solution from a convincing explanation
Ask a model to "think step by step" and it often gets more answers right. But is the reasoning it writes down how it really got there? You can test that.
LESSON OVERVIEW12 min lesson
Lesson overview
Ask a model to "think step by step" and it often gets more answers right. But is the reasoning it writes down how it really got there? You can test that.
What you’ll explore
- Reasoning capability is evaluated through problem-solving behavior; generated explanations can help or mislead and are not guaranteed transcripts of the computation that caused an answer.
GO TO THE SOURCE
Original explanations, connected to the research.
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models (Wei et al., 2022)Large Language Models are Zero-Shot Reasoners (Kojima et al., 2022)Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Prompting (Turpin et al., 2023)Measuring Faithfulness in Chain-of-Thought Reasoning (Lanham et al., 2023)Suggest a correction
A precise note can make an explanation better.
Choose the scene and describe what needs attention. Download a feedback file to share through a channel you already use. This page does not send feedback or connect you with a reviewer.