1.7.24 · D5Thermodynamics

Question bank — Entropy and disorder — Boltzmann S = k·ln(W)

1,912 words9 min readBack to topic

True or false — justify

Every microstate of an isolated system is equally likely.
True. This is the fundamental postulate of statistical mechanics; equilibrium is not a preferred microstate but a macrostate that happens to own the most of these equally-likely microstates.
A macrostate with higher entropy is always the one nature ends up in.
Almost, but say it right. Nature drifts to the macrostate with the largest because it holds nearly all microstates; for a system of about particles that peak is so sharp it is effectively certain — but it is a statement of overwhelming probability, not a law of force.
Doubling the number of microstates doubles the entropy.
False. , so doubling adds only ; entropy grows with the logarithm of , not itself.
Entropy is additive for two independent systems.
True. because and turns that product into a sum — this additivity is the very reason the logarithm appears.
A system with has zero entropy.
True. ; a single unique arrangement (like a perfect flawless crystal cooled to , where all jiggling stops) has nothing to count.
Entropy can never decrease anywhere in the universe.
False. The entropy of an isolated system never decreases; a sub-system (a fridge interior, a freezing puddle) can lose entropy as long as the surroundings gain more, so the total still rises.
"Disorder" and "entropy" are exactly the same thing.
False. "Disorder" is a fuzzy visual label; entropy is precisely . A neat-looking crystal made of mixed isotopes can carry large entropy from the countless isotope arrangements you cannot see.
The Boltzmann constant changes the physics of which macrostate wins.
False. only sets units (J/K) so that matches the older thermodynamic (Clausius) entropy; the ranking of macrostates depends only on , which never reorders.
For a free expansion, tells you heat was absorbed.
False (subtle). Free expansion into vacuum is irreversible with ; the relation (from ) holds only along a reversible path. Entropy still rises because it is a state function — you compute it along an imaginary reversible route, not the actual one.
Adding energy to a system always increases its entropy.
False in general. For ordinary systems yes, but a system with a bounded, finite energy ladder (e.g. spins that can only point up or down) can reach a state where adding energy forces more spins to the higher level, actually reducing . There falls as energy rises — this is precisely what "negative absolute temperature" means (hotter-than-infinity, not colder-than-zero).

Spot the error

"There are more disordered microstates because a force pushes systems toward chaos."
The error is inventing a force. Nature is blind — every microstate is equally likely; the disordered macrostate simply contains vastly more of them, so you land there by counting alone.
"Since , tripling multiplies by 3."
Wrong operation. , so goes up by (an addition), not up by a factor of 3.
"Two identical gas boxes side by side have entropy because their microstates combine."
The microstate counts multiply (), but entropies add: . You multiply , you add — that is exactly what the enforces.
" for '3 heads from 5 coins' is , since 3 coins are heads."
You must count which coins are heads: different choices. is a count of arrangements, not the number of heads.
"The all-tails macrostate is impossible because its entropy is zero."
Zero entropy means , i.e. exactly one microstate — that is perfectly possible, just very improbable compared to the many-way middle macrostates. Rare forbidden.
"Melting ice raises entropy because heat always raises entropy."
The heat enables new configurations, but the entropy rise is from — molecules gain access to far more positions/orientations. The count is the cause; heat is the enabler.
"Shannon's information entropy is a different quantity, unrelated to ."
Same core idea. Shannon entropy is of possibilities measured in bits; Boltzmann's is the same log-of-multiplicity measured in joules per kelvin via the factor .
"Removing a partition between two halves of the SAME gas gives just like mixing."
Error — this is the Gibbs paradox. If the molecules on both sides are identical and indistinguishable, swapping a left molecule with a right one produces no new microstate, so does not actually grow and . The jump only appears when the two gases are different (distinguishable) species.

Why questions

Why a logarithm and not, say, a square root?
Only makes entropy additive while multiplicities multiply, and the unique continuous solution to that equation is . A square root does not turn products into sums.
Why does entropy scale linearly with system size if is "only" a log?
Because grows exponentially in (roughly ), so — the log of an exponential is linear. The two effects cancel to give a bulk, extensive quantity.
Why is the equilibrium macrostate so overwhelmingly likely for real gases?
For two-sided choices the counts follow the binomial , whose peak sits at . Its width (the spread of appreciable probability) is about particles, while the peak position is , so the relative width is — the Central-Limit shrinking of fluctuations. At , , an unimaginably thin spike, so essentially every microstate belongs to the central macrostate.
Why does as temperature ?
At absolute zero a system settles into its unique ground configuration, so and — this is the statistical content of the third law of thermodynamics.
Why do we say equilibrium is "preferred" if all microstates are equally likely?
"Preferred" refers to the macrostate, not any single microstate. The equilibrium macrostate wins because it owns an overwhelming share of the equally-weighted microstates.
Why does mixing two different gases raise entropy even without heat exchange?
Each species suddenly accesses the whole doubled volume — position choices multiply just like a free expansion, so jumps and rises purely from counting, no energy transfer required. (Crucially, this needs the gases to be distinguishable; see the Gibbs-paradox trap above.)
Why does the Boltzmann distribution favour low-energy states yet allow high-energy ones?
A single low-energy state is more probable per state, but there are often many more high-energy states; the observed population balances "probability per state" against "number of states" — again a multiplicity argument.

Edge cases

What is , and , for a system in exactly one possible microstate?
and — the degenerate floor of entropy, the reference point the third law fixes.
Can a macrostate have ?
No physically realizable macrostate can; would mean it corresponds to no microstate, i.e. it simply does not exist. Every observable macrostate has .
If a gas freely expanded and then you reset every molecule's exact position, has entropy really increased?
Entropy is a property of the macrostate, not one microstate. After expansion the accessible position-space is doubled, so (and ) rose regardless of the specific microstate you happen to inspect.
For molecule expanding into double the volume, is meaningful?
Formally yes, , but with one molecule fluctuations are enormous and the "Second Law" is only statistical — the molecule can wander entirely back into the original half quite often. Thermodynamic certainty needs large .
Can identical particles ever give a smaller entropy than you'd naïvely count?
Yes — that is the point of the Gibbs correction. Because permuting indistinguishable particles yields the same microstate, the honest count divides out those fake rearrangements, lowering and keeping entropy properly extensive.
Can a system's entropy DECREASE when you pump energy into it?
Yes, for a system with a capped energy ladder (spin systems, certain lasers). Once more than half the particles are in the top level, extra energy shoves the population toward the single "all-up" configuration, so shrinks and falls — the regime of negative absolute temperature, which is actually hotter than any positive temperature.
Can a self-organizing system (crystal forming, cells growing) lower its own entropy?
Yes, locally — it looks tidier. But it dumps enough entropy (usually as heat) into its surroundings that the total of system-plus-surroundings still increases, honouring the second law.
At the exact peak of a coin distribution, is maximal for that ?
Yes — the central macrostate () has the largest , hence the largest , hence the maximum entropy available to that fixed set of coins.

Recall One-line reflex to build

Whenever a trap tempts you, ask the single question: "how many microstates does this macrostate own?" Every correct answer on this page falls out of that.

Connections