2.4.11 · D2Thermodynamics & Statistical Mechanics (Advanced)

Visual walkthrough — Average energy from partition function

1,911 words9 min readBack to topic

Step 0 — What are the pieces? (build the vocabulary before any math)

Before a single symbol, meet the cast.

The knob we will actually turn is not but its inverse:

Figure — Average energy from partition function

Look at the figure: cold (left) piles the marble in the lowest box; hot (right) spreads it across all boxes. Same boxes, same energies — only the dial changed.

Prerequisites we lean on live here: Boltzmann distribution and Partition function (canonical ensemble).


Step 1 — How likely is each box? (the Boltzmann weight)

WHAT. Assign each box a raw "unnormalized likeliness" number.

WHY the exponential and not, say, ? Because we want two independent systems' weights to multiply (energies add: ). Only the exponential converts "add the energies" into "multiply the weights." That is the unique property we need.

PICTURE. Each box gets a bar whose height is . High-energy boxes have tiny bars; the cold dial makes far bars almost invisible.

Figure — Average energy from partition function

Step 2 — Make the weights into honest probabilities (enter )

WHAT. The bars do not add up to , so they are not yet probabilities. Divide by their total.

Now the honest probability of landing in box :

WHY. A probability must sum to ; dividing by is the one rescaling that does it. is the normalizer.

PICTURE. Same bars as Step 2's figure, but now stacked into a full-height column of "shares."

Figure — Average energy from partition function

Step 3 — Write the average energy honestly

WHAT. The average (mean) energy is each box's energy weighted by how often we visit it.

WHY. This is the only definition of an average — value times probability, summed. Nothing clever yet.

The annoyance: that sum has an extra factor glued onto each weight. Computing it directly, box by box, is tedious. Step 4 removes the tedium.

PICTURE. Bars again, but each bar now tagged with its energy ; the average is the "balance point" (centre of mass) of the energy values weighted by bar height.

Figure — Average energy from partition function

Step 4 — The derivative trick: manufacture the missing

WHAT. Ask: what happens to a single weight if we nudge the dial ?

  • means "rate of change as increases, holding energies fixed."
  • The chain rule: derivative of is times the derivative of the stuff. Here stuff , whose slope in is .

WHY this tool. We wanted an extra multiplying each weight (Step 3's annoyance). Differentiation in produces exactly that factor — for free, with a minus sign attached. That is why the derivative, and not any other operation, is the right key.

PICTURE. Turn the dial by a tiny ; watch each bar shrink. A tall-energy bar (big ) shrinks by more — because its shrink rate is , proportional to . The picture is showing you the factor being born.

Figure — Average energy from partition function

Step 5 — Replace the whole sum with one derivative of

WHAT. Add up Step 4 over every box:

  • The derivative of a sum = sum of derivatives, so we differentiate term by term.
  • The result is minus the very sum that annoyed us in Step 3.

Flip the sign to isolate that sum:

WHY. Step 3's tedious sum is now just "the slope of ." One quantity, , and its slope carry everything.

PICTURE. Two curves of vs (a decreasing curve). The steepness of the slope at a point is the weighted energy sum. Where falls steeply, energies being visited are large.

Figure — Average energy from partition function

Step 6 — Substitute, then fold into a log

WHAT. Put Step 5 into Step 3:

  • The stray from the average is still there — that is the normalization we must not forget.

Now the tidy-up. Recall a fact about logarithms and the chain rule:

  • is the natural logarithm; its derivative rule "" is precisely the " slope of " shape we have.

So the two operations — divide by and take the slope — collapse into one operation on :

WHY the . It is not decoration — the log is the exact function whose derivative is the messy combination "." Using means we never write the by hand again.

PICTURE. Plot against (a downward-bending curve). Its downhill slope, negated, reads off directly as at every temperature.

Figure — Average energy from partition function

Step 7 — Edge & limiting cases (never leave a gap)

Every derivation must survive its extremes. Test on the two-level system: boxes at energies and , giving and .

PICTURE. The -vs- curve for the two-level system: flat at when cold, rising, then saturating at when hot. Both plateaus are the limits above.

Figure — Average energy from partition function

The same machine, differentiated twice, gives energy fluctuations and links to Heat capacity and energy fluctuations; the continuous quadratic case reproduces the Equipartition theorem; and the discrete ladder gives the Quantum harmonic oscillator — thermal result. One formula, all of them.


The one-picture summary

Figure — Average energy from partition function

Boxes → weights → normalize into → one derivative of (with a minus) → the average energy. The whole page in a single arrow chain.

Recall Feynman retelling — the whole walkthrough in plain words

Picture a row of numbered boxes; each box has an energy tag. A temperature dial decides how often a jumpy marble visits each box — cold means it hugs the low boxes, hot means it wanders everywhere. To turn "how often" into real chances, we add up every box's raw likeliness into one grand total called , then each box's chance is its slice of . Now the average energy is just each box's energy times its chance, summed — but that sum is fiddly because of the extra energy tag on every term. Here's the magic: if you gently turn the dial and watch change, the math automatically multiplies each box by its own energy (that's exactly the factor we were missing), with a minus sign tagging along. Divide by and you've divided-and-sloped in one move — which is the same as sloping the logarithm of . Flip the sign and there it is: the typical energy of the system, from one nudge of a counter. Test it cold (energy freezes to the bottom), test it hot (energy averages out) — it passes both. That's the entire idea.


Active recall