2.4.12 · D5Thermodynamics & Statistical Mechanics (Advanced)
Question bank — Free energy from partition function
Before we start, a one-line reminder of the symbols so nothing is used unexplained:
Two pictures anchor everything below. The first shows why multiplying 's becomes adding 's (extensivity). The second shows the shape of and why its slope is .


True or false — justify
- is dimensionless for any system. ::: For a discrete sum of it is dimensionless, but the classical phase-space is made dimensionless only by dividing by per degree of freedom (and for identical particles) — omit those factors and carries stray units.
- Adding a constant to every energy level leaves all measurable predictions unchanged. ::: False for and (both shift: , ), but true for observables that come from derivatives like and ; shifts by exactly , as physically expected.
- is only valid at equilibrium. ::: True — presupposes Boltzmann-weighted microstates, which is the equilibrium distribution; out of equilibrium is defined but not equal to .
- Because multiplies for independent subsystems, adds for them. ::: True — that is the whole point of the logarithm (see figure 1): , so is extensive while is multiplicative.
- is always negative. ::: False — the sign of depends on the zero of energy and on ; only the changes in are physically meaningful, so its raw sign carries no universal meaning.
- Lowering temperature always lowers . ::: False — the slope in figure 2 is , so increases as drops (since ); decreases as rises.
- The equilibrium state minimizes at fixed . ::: True — this is the defining variational property: among all conceivable arrangements at fixed , the real equilibrium is the one sitting at the lowest value of , not the minimum of alone.
- Doubling the number of microstates always doubles . ::: False — , so doubling subtracts a fixed from ; only replicating an independent copy of the whole system doubles .
Spot the error
- "." ::: Missing normalization: is an unnormalized weighted sum; you must divide by , giving .
- "." ::: Wrong sign: carries a built-in minus, so ; the plus sign would make entropy negative.
- "For independent particles ." ::: Wrong operation: energies add inside the exponent, which makes exponentials multiply, so (up to a for indistinguishability), not .
- "." ::: Sign error again: from at fixed , pressure is ; the vault result already has the correct sign baked in.
- " (dropped the log)." ::: Without the log would multiply instead of add when systems combine, breaking extensivity; the logarithm is exactly what converts the product structure of into an additive potential.
- "Since , the most probable microstate is always the ground state." ::: The most probable single microstate is the lowest-energy one, but the most probable energy level can be a high one if it has many microstates — probability of a level is times its degeneracy.
Why questions
- Why a logarithm in rather than itself? ::: Independent systems multiply their ; taking turns that product into a sum (figure 1), so becomes extensive (scales with system size) — the essential requirement of a thermodynamic potential.
- Why does cancel exactly in ? ::: Because , the term precisely subtracts the in , leaving pure — a structural fact, not a coincidence.
- Why is entropy and not something involving directly by counting? ::: The two are the same thing: start from Gibbs entropy with , so ; substituting gives , and differentiating reproduces exactly this — the thermodynamic derivative and the microscopic count agree because was built from those same .
- Why does the classical harmonic oscillator give regardless of ? ::: Because makes , and sits only in the constant; the equipartition energy (two quadratic degrees of freedom) is independent of stiffness — see Equipartition theorem.
- Why can we build all thermodynamics from by differentiation instead of returning to microstates? ::: Every observable is an average or fluctuation of energy, and those are encoded as - and -derivatives of ; the single function therefore stores all the microstate information we need.
- Why is (not ) minimized at fixed ? ::: At fixed the system can exchange energy with the bath, so it trades internal energy against entropy; minimizing correctly balances "low energy" against "high disorder," which minimizing alone ignores — see Helmholtz vs Gibbs free energy.
Edge cases
- What is as ? ::: Only the ground state survives in , so and ; the entropy term vanishes and approaches the ground-state energy.
- What happens to for the two-level system as ? ::: makes both states equally likely, so (the average of and ), not — high temperature means maximal ignorance, not maximal energy.
- Can diverge, and what does that mean? ::: Yes — e.g. a free particle in infinite volume or a hydrogen atom summed over all bound states; a divergent signals that a normalizable equilibrium doesn't exist without an additional constraint (volume cutoff, regularization).
- For a two-level system, how does the value of entropy behave at versus ? ::: At only the ground state is occupied so (one accessible state, zero disorder); at both states are equally likely so (a maximum, not zero) — the two limits are physically opposite, so does not vanish at high .
- Is valid in the grand canonical ensemble? ::: No — there the controlled potential is the grand potential with summing over particle number too; see Grand canonical ensemble and grand potential.
- What if all microstates have the same energy ? ::: Then and , so recovers the Boltzmann entropy exactly — the canonical result collapses to the microcanonical one.
- Does the formula assume distinguishable particles? ::: The single-system makes no such assumption, but building for many identical particles requires a (Gibbs correction) to avoid the entropy-of-mixing paradox — see Ideal gas from the partition function.
Recall One-line summary of the traps
Almost every error is one of three things: dropping the (breaks extensivity), dropping the normalization (unnormalized averages), or dropping a minus sign (from ).