2.4.12 · D1Thermodynamics & Statistical Mechanics (Advanced)

Foundations — Free energy from partition function

1,724 words8 min readBack to topic

Before you can read the parent note Free energy from the partition function, you must own — with a picture — every symbol it throws at you. Nothing below is assumed. We build each piece from the one before it.


1. The stage: microstates

Picture a single coin: it has exactly two microstates, heads or tails. A system of three coins has microstates. A gas has an astronomically huge number, but the idea is identical — a microstate is a single "snapshot" from the pile of all possible snapshots.

Why the topic needs this: is going to be a sum over microstates. If you don't picture the pile of snapshots first, the summation symbol later is meaningless. See Boltzmann distribution and microstates for the deeper story.


2. Energy of a microstate:

In the coin picture, imagine a coin that costs nothing to sit heads-up () but costs a fixed amount (Greek letter "epsilon", a small energy) to flip tails-up. Then the tails microstate has and the heads microstate has .

Why the topic needs it: energy is the currency that decides which microstates are cheap (common) and which are expensive (rare). Everything that follows weighs microstates by their .


3. Temperature and the "coldness"

Why introduce at all — why not just use ? Because every Boltzmann weight (next section) is an exponential of . The energies always show up multiplied by , never by directly. Writing makes those formulas clean and — crucially — lets us differentiate with respect to later to pull energies out of .


4. The Boltzmann weight

Here we meet the exponential. Why this tool and not a simpler one?

We want a number that is large for cheap (low-) microstates and small for expensive (high-) ones, and that smoothly interpolates as temperature changes. The function does exactly this: it equals at , shrinks toward as grows, and never goes negative (weights must be positive). Feeding it gives the Boltzmann weight .

Why the topic needs it: this single factor encodes the entire preference rule "cold prefers low energy." Sum these factors and you get .


5. The partition function : the sum symbol

Why "partition"? Because tells you how the total probability gets partitioned (divided up) among the microstates. It is a weighted count: at high temperature approaches the raw number of microstates; at low temperature it collapses toward just counting the ground states.

Why the topic needs it: is the master quantity. Once you have it, the parent note shows every thermodynamic property drops out by differentiation — no more looping over microstates by hand.


6. Probability and the log

Now the logarithm. Why does appear everywhere?

The logarithm answers one question: "to what power must I raise to get this number?" Its magic property is It turns multiplication into addition. This is the whole reason free energy uses and not : when you join two independent systems their partition functions multiply (), but energies and free energies should add. Taking converts the product into a sum, making extensive (proportional to system size).

Why the topic needs it: is the exact tool that makes (multiplicative) into (additive). Without it, would double when you'd expect it to double — but squares instead. See Legendre transforms in thermodynamics for how then relates to other potentials.


7. The thermodynamic cast: , ,

Why the topic needs all three: the parent note assembles and watches cancel, leaving the clean result . You cannot follow that cancellation without knowing what each letter is.


8. The derivative : the slope tool

Why this tool? Look at a single Boltzmann weight: Differentiating pulls the energy down in front. That is precisely the trick the parent note uses to get internal energy: differentiating with respect to conjures up the average energy without a separate sum. The derivative is the machine that extracts physics from .


Prerequisite map

Microstate i

Energy E_i

Temperature T and k_B

Coldness beta

Boltzmann weight exp minus beta E

Sum over states gives Z

Probability p_i equals weight over Z

Logarithm ln Z

Internal energy U average of E

Entropy S spread of p

Free energy F equals minus k_B T ln Z

Beta slope tool

Each arrow says "you need this before that." The whole page flows left-to-right into the boxed result .


Equipment checklist

Cover the right side; can you answer each before moving on?

What is a microstate, in one sentence?
One fully specified snapshot of the system — every detail nailed down.
What does the subscript in mean?
"The energy belonging to microstate number ."
Define and say whether large is hot or cold.
; large = cold.
Why use the function for the weight rather than something linear?
It stays positive, equals at zero energy, and decays smoothly for costly states — exactly matching "cheap states common, expensive states rare."
What does instruct you to do?
Loop over every microstate and add up the listed quantity.
Write the partition function.
.
Why is called the "partition" function?
It shows how total probability is partitioned among the microstates.
State the microstate probability.
.
What key property of makes free energy extensive?
turns multiplied 's into added 's.
Define as an average.
.
What does entropy measure?
How spread out the probability is across microstates (messiness / options).
Write Helmholtz free energy in terms of .
.
What does differentiating with respect to give?
— it pulls the energy out front.
What single result does this whole map feed into?
.