4.4.8 · D1Alignment, Prompting & RAG

Foundations — Self-consistency and tree-of-thought

1,890 words9 min readBack to topic

This page builds every symbol, word, and picture the parent note leans on — starting from a reader who has never seen probability, sampling, or search. Read it top to bottom; each block earns the next.


0. The characters in the story

Before any formula, meet the two nouns the whole topic revolves around.

Figure — Self-consistency and tree-of-thought

We now name these with letters, because the parent page does.


1. The symbols , , and the prompt

We call a nuisance variable: something we must acknowledge exists but want to get rid of. The tool that removes it is the next block.


2. Probability and the summation sign

The parent writes and a big . Two new symbols — let's earn both.

Figure — Self-consistency and tree-of-thought

The multiplication rule (read: "chance of the path, times chance the path gives that answer") is what turns the sum into the parent's form .


3. Temperature and sampling — where the many paths come from

Figure — Self-consistency and tree-of-thought

4. The indicator and counting votes

The parent uses . Two pieces: the superscript and the box.


5. Why voting beats one guess — the counting symbols

The parent's "Condorcet" formula uses and .


6. Symbols for Tree-of-Thought: state, generator, evaluator

Figure — Self-consistency and tree-of-thought

Prerequisite map

Probability p and given bar

Marginalize: sum over r

Summation sign sigma

Self-Consistency

Temperature and sampling

Indicator and argmax vote

Monte Carlo estimate

Choose N k and Condorcet

State generator evaluator

Tree-of-Thought

Beam width depth branching

4.4.8 topic

Each foundation on the left feeds exactly the part of the parent it unlocks. Trace any arrow back and you can see why that symbol had to be built first.


Equipment checklist

Cover the right side and answer each aloud — if any stalls, reread that section.

What does the vertical bar in mean?
"given" — the probability of given the prompt already fixed.
What does do to the reasoning path ?
Adds over every path, erasing the nuisance and leaving the answer marginal (marginalization).
Why must temperature be for self-consistency?
At temperature 0 all chains are identical, so there is nothing to vote across.
What does evaluate to?
1 if chain 's answer equals , else 0 — a vote-counting switch.
What does return?
The answer that gets the most votes (the winner), not the vote count itself.
What does count?
The number of ways to choose which of the chains are correct.
What is a "state" in Tree-of-Thought?
The prompt plus the partial reasoning built so far.
What do and do?
generates candidate next thoughts; scores how promising a state is.
What do , , stand for in ToT cost?
Branching factor, beam width kept per level, and tree depth.
Which single capability does ToT have that CoT and SC do not?
Backtracking — abandoning a dead-end branch and trying another.