2.4.8 · D2Thermodynamics & Statistical Mechanics (Advanced)

Visual walkthrough — Statistical mechanics — microstate, macrostate

2,207 words10 min readBack to topic

We assume you know nothing but counting. Every symbol is earned before it is used.


Step 1 — What is a "state"? Two words we must not mix

WHAT. Take coins in a row. Each coin is either H (heads) or T (tails). Two totally different questions:

  • "Give me the exact pattern" — like H T T H. That full ordered list is a microstate.
  • "Just tell me how many are heads" — one number . That is a macrostate.

Here = the number of coins, and = the number of heads. Nothing else yet.

WHY split them? Because in a real gas you can only measure the second kind (a couple of bulk numbers). You can never write down the first kind. So physics is forced to ask: how many microstates share the same macrostate?

PICTURE. The left column is one microstate (a full pattern). The right box groups many patterns under a single label "2 heads".


Step 2 — Count every microstate: why

WHAT. How many complete patterns exist for coins? Coin 1 has 2 choices; for each of those, coin 2 has 2 choices; and so on.

WHY multiply? This is the fundamental counting principle: independent choices multiply, because every choice for coin 1 can be paired with every choice for coin 2. Two coins → patterns; three coins → .

  • — the number of options per coin (H or T).
  • — how many coins, i.e. how many times we multiply.
  • — the grand total of distinct microstates.

PICTURE. A branching tree: each level doubles the number of leaves. Count the leaves at the bottom — that is .

Recall Why not add the 2's?

Adding () would count choices for one coin at a time in isolation. But a pattern needs a choice for every coin simultaneously — the choices stack, and stacking independent choices means multiply. ::: multiply, because each coin's option pairs with every option of the others.


Step 3 — Count one macrostate: why

WHAT. Fix the macrostate to "exactly heads". How many patterns realise it? We must choose which of the slots are heads.

WHY a combination and not a permutation? Because the heads are identical — swapping two heads gives the same pattern. We only care which slots are heads, not in what order we picked them. "Choose slots out of , order irrelevant" is exactly the combination (see Binomial and Gaussian distributions):

Reading it term by term:

  • — line up all coins in every order ( factorial ).
  • — but the heads are interchangeable; their reorderings give one pattern, so divide them out.
  • — likewise the tails are interchangeable; divide out their reorderings too.
  • — read " choose ": the number of distinct patterns with heads.

PICTURE. Below: the slots as boxes; we shade a chosen subset of . Different shadings that reuse the same slot-set are the same macrostate — that's why we divide.


Step 4 — The whole distribution: plot

WHAT. Compute for every from to and plot it. For the values are the row of Pascal's triangle.

WHY plot it? A picture reveals the punchline instantly: the counts are not flat. The extremes ( or ) have ; the middle () towers above everything.

PICTURE. Bars of vs . The green centre bar dwarfs the red edge bars. That height difference is why you never see all-heads.


Step 5 — The forecast that must come true:

WHAT. Add up the multiplicities of all macrostates. If our two counts (Step 2 and Step 3) are consistent, this sum must rebuild every microstate exactly once.

  • — sweep across every macrostate, .
  • — microstates in that one macrostate.
  • — the grand total from Step 2.

WHY it works. The binomial theorem says . Put : every term becomes just , and the left side is . So partitioning microstates by macrostate loses none.

PICTURE. The bars from Step 4, stacked end-to-end, exactly fill the total — no overlap, no gaps.


Step 6 — From counts to probability, and the degenerate edges

WHAT. By the Fundamental postulate of statistical mechanicsevery accessible microstate is equally likely — the probability of a macrostate is its share of the total:

  • — ways to get heads (favourable microstates).
  • — all microstates (equally likely, by the postulate).
  • — the probability you measure macrostate .

The edge / degenerate cases — none are skipped:

  • (all tails) or (all heads): , so . The rarest allowed macrostates — they exist but are almost never seen.
  • (only when even): the largest , the most probable macrostate.
  • odd: no exact middle; the two central values tie for the peak.
  • : only two macrostates, each , each — the split is invisible (need many coins for a sharp peak).

PICTURE. Probability curve for a large , with the tiny edge bars marked in red and the towering peak in green — plus an arrow showing the peak width shrinking relative to .


Step 7 — Where does the width come from? Deriving

Before we can talk about "the width shrinking", we must say what "width" means and why it equals — not just cite it.

WHAT & WHY (the trick that makes appear). Write the head-count as a sum of one little counter per coin. For coin let if it's heads and if tails. Then

  • — the -th coin's contribution: or .
  • — total heads, just the sum of those.

For one fair coin the mean is and its variance is

  • — probability that coin shows heads.
  • — variance of a single 0/1 coin (largest when , zero when the coin is rigged to always land one way).

The key rule (why variances, not 's, add). For independent pieces, variances add — the squared strays accumulate without cross-terms because one coin's luck tells you nothing about another's:

Take the square root to get the width itself:

  • — number of independent coins; it enters once, linearly, inside the variance.
  • — turning variance back into a width halves the exponent, so .

PICTURE. Left: variance of one coin, , peaking at . Right: independent strays add as squares (Pythagoras-style), so the total width is longer, not longer.


Step 8 — Why coins means one answer forever

WHAT. The peak of sits at the centre . From Step 7 its width (standard deviation) is , while its position is . So the relative spread — width measured as a fraction of the whole — is

  • — the width just derived in Step 7.
  • — where the peak sits.
  • — the fractional fluctuation, vanishing for large .

WHY it matters. For , : the fraction of heads is pinned to to about part in . The measurable macrostate simply does not move. That frozen, most-probable macrostate is equilibrium — and its logarithm is entropy.

PICTURE. Three curves rescaled onto fraction-of-heads : as grows the bell collapses to a spike at .


The one-picture summary

Everything at once: the branching tree (all microstates) feeds into the bar chart ( per macrostate), whose total re-sums to , whose normalised version is , whose width sharpens relative to into equilibrium.

Recall Feynman retelling — the whole walkthrough in plain words

Line up coins. Each coin flips two ways, so there are complete patterns — that's every microstate. But you, the experimenter, only see one number: how many are heads, the macrostate. To find how many patterns give a certain head-count , you choose which slots are heads and ignore the order — that's . Plot those counts and a mountain appears: one lonely pattern at "all heads", a towering pile at "half heads". Add all the piles back up and you recover exactly (nothing lost). Since every pattern is equally likely, the probability of a macrostate is just its pile-height over . Now the magic of big numbers: give each coin a little -or- counter; each wobbles by in variance, and because independent wobbles add as squares, the total wobble is — a random-walk , not a straight-line . So the mountain's width grows like but its centre grows like , making it razor-thin relative to its size. At coins it's a needle at exactly half heads. That immovable, overwhelmingly-favoured macrostate is what we call equilibrium — and heat, temperature, and irreversibility are all just this counting story wearing different clothes.


Connections