Step by Step
C
Chain of Thought — one reasoning path
Chain of Thought generates a single sequential reasoning path from question to final answer.
Example: a Chain-of-Thought response working through one specific sequence of reasoning steps to reach a final answer.
T
Tree of Thoughts — multiple branches, evaluated
Tree of Thoughts (ToT) generates multiple reasoning branches simultaneously and evaluates them — like a chess player thinking several moves ahead along different possible lines and choosing the best branch, rather than committing to just one single line of thinking upfront.
Example: ToT generating three different possible approaches to a complex problem, evaluating each one's promise, and pursuing the most promising branch further, potentially backtracking if a branch turns out to be a dead end.
S
Self-consistency — simple majority vote improvement
Self-consistency generates multiple independent Chain-of-Thought chains and takes the majority-vote answer among them — a simpler technique than Tree of Thoughts, but still a very effective accuracy improvement.
Example: generating 5 independent Chain-of-Thought reasoning chains for the same problem and taking whichever final answer appears most frequently among them as the selected response.
⚡
The power ranking — ToT > Self-consistency > CoT > zero-shot
For genuinely difficult reasoning problems, the general power ranking is: Tree of Thoughts is most powerful, followed by Self-consistency, followed by Chain-of-Thought, followed by plain zero-shot prompting.
Example: choosing Tree of Thoughts specifically for an unusually difficult reasoning problem requiring exploration of multiple possible approaches and backtracking, rather than settling for a simpler technique.
Applied Walkthrough
1
A team faces an unusually difficult reasoning problem that seems to require exploring several different possible approaches, with some approaches potentially being dead ends requiring backtracking.
2
Ask: would plain Chain-of-Thought (a single sequential reasoning path) be well suited to this kind of problem? Not necessarily — a single path doesn't allow for exploring alternatives or backtracking if that one path turns out to be unproductive.
3
Tree of Thoughts is much better suited here, since it explicitly generates multiple reasoning branches, evaluates each, and can pursue the most promising one — much like a chess player considering several possible move sequences before committing to one.
4
This matches the general power ranking for difficult reasoning problems: ToT > Self-consistency > CoT > zero-shot, with ToT specifically suited for problems requiring backtracking or exploration of genuinely different alternative approaches.
Exam Application
Exams test whether you can distinguish Chain-of-Thought (single reasoning path) from Tree of Thoughts (multiple branches, evaluated) from Self-consistency (multiple independent chains, majority vote), and whether you know the general power ranking for difficult reasoning tasks: ToT > Self-consistency > CoT > zero-shot.
⚠ Common Trap
The most common trap is confusing Tree of Thoughts with Self-consistency, since both involve generating multiple reasoning attempts. Self-consistency generates multiple INDEPENDENT complete chains and takes a majority vote at the end; Tree of Thoughts generates and actively EVALUATES branches DURING the reasoning process, potentially abandoning less-promising branches partway through rather than always completing every path.
✓ Quick Self-Check
1. How many reasoning paths does Chain of Thought generate?
One single sequential path.
Tap to reveal / hide
2. What does Tree of Thoughts do differently from Chain of Thought?
Generates multiple reasoning branches simultaneously and evaluates them, rather than committing to just one sequential path.
Tap to reveal / hide
3. What does self-consistency do?
Generates multiple independent Chain-of-Thought chains and takes the majority-vote answer among them.
Tap to reveal / hide
4. What is the general power ranking for difficult reasoning problems, from most to least powerful?
Tree of Thoughts > Self-consistency > Chain-of-Thought > zero-shot.
Tap to reveal / hide
5. What kind of problems is Tree of Thoughts specifically well suited for?
Problems requiring backtracking or exploration of genuinely different alternative approaches.
Tap to reveal / hide