Noesis
1.7.24Thermodynamics

Entropy and disorder — Boltzmann S = k·ln(W)

1,937 words9 min readdifficulty · medium
🇮🇳 Yeh note Hinglish mein padho →

WHAT are we even talking about?

The Boltzmann formula

WHY the logarithm? (Derivation from first principles)

We want a quantity SS that measures "how many ways," but with one crucial property: entropy must be additive for independent systems, while the number of ways multiplies.

Step 1 — Counting combines by multiplication. Take two independent systems AA and BB with multiplicities WAW_A and WBW_B. For every arrangement of AA you can pair any arrangement of BB: WAB=WA⋅WBW_{AB} = W_A \cdot W_B Why this step? Independent choices multiply (3 shirts × 4 pants = 12 outfits).

Step 2 — But entropy is extensive (it should add). Energy, volume, mass all double when you double the system. We demand the same: SAB=SA+SBS_{AB} = S_A + S_B Why this step? Two identical gas boxes side by side should have twice the entropy — it's a bulk "amount" property.

Step 3 — Find a function turning × into +. We need S=f(W)S = f(W) such that f(WAWB)=f(WA)+f(WB)f(W_A W_B) = f(W_A) + f(W_B). The unique (continuous) solution to f(xy)=f(x)+f(y)f(xy)=f(x)+f(y) is the logarithm: f(W)=kln⁡Wf(W) = k\ln W Why this step? ln⁡(xy)=ln⁡x+ln⁡y\ln(xy)=\ln x + \ln y is exactly the multiplication-to-addition rule. The constant kk just sets the units (so SS comes out in J/K and matches Clausius' thermodynamic entropy).

S=kln⁡W\boxed{S = k \ln W}

Figure — Entropy and disorder — Boltzmann S = k·ln(W)

HOW to count WW — worked examples

The Second Law, re-read

Common mistakes (Steel-manned)

Recall Feynman: explain it to a 12-year-old

Imagine a box of LEGO. There's only one way to have them all stacked into a perfect tower, but millions of ways for them to be scattered on the floor. If you shake the box, you almost always get "scattered" — not because shaking hates towers, but because scattered has way more versions. Entropy is just a score for "how many versions look like this." More versions = bigger score = what you'll usually see. The ln⁡\ln in the formula is a trick so that putting two boxes together makes the scores add up instead of multiplying.

Connections

  • Second Law of Thermodynamics — entropy of an isolated system never decreases.
  • Clausius Entropy dS = dQ_rev / T — the thermodynamic twin that S=kln⁡WS=k\ln W reproduces.
  • Free Expansion of an Ideal Gas — Example 2 in action.
  • Microstates and Macrostates — the bookkeeping behind WW.
  • Boltzmann Distribution — how energy populates microstates.
  • Information Entropy (Shannon) — same ln⁡(count)\ln(\text{count}) idea, bits instead of joules.
  • Third Law of Thermodynamics — at T→0T\to 0, W→1W\to 1 so S→0S\to 0.

Flashcards

What does WW represent in S=kln⁡WS=k\ln W?
The multiplicity — the number of microstates consistent with a given macrostate.
Why is the logarithm used in Boltzmann's formula?
Multiplicities multiply (WAB=WAWBW_{AB}=W_AW_B) but entropy must add (SAB=SA+SBS_{AB}=S_A+S_B); only ln⁡\ln turns × into +.
Value and units of the Boltzmann constant kk?
1.38×10−231.38\times10^{-23} J/K.
Multiplicity of a "3 heads out of 5 coins" macrostate?
(53)=10\binom{5}{3}=10.
Entropy change when a gas of NN molecules freely expands to double its volume?
ΔS=Nkln⁡2\Delta S = Nk\ln 2 (per mole, Rln⁡2R\ln 2).
If you triple WW, how does SS change?
It increases by kln⁡3k\ln 3, not by a factor of 3.
Why does the Second Law "work"?
High-WW macrostates contain almost all microstates, so a randomly-exploring system overwhelmingly ends up there; WW maximizes.
What is the entropy of a unique, perfectly ordered state (W=1W=1)?
S=kln⁡1=0S=k\ln 1 = 0.
Steel-man: why is "entropy = disorder" not quite right?
"Disorder" is fuzzy; the rigorous meaning is "number of accessible microstates," which can rise even in visually ordered systems.
Fundamental postulate of statistical mechanics used here?
All accessible microstates of an isolated system are equally probable.

Concept Map

counted by

compatible ones give

so likeliest macrostate has max

large W means

independent systems

entropy is extensive

unique solution

input to

sets units of

defines

shows how to count

Macrostate - what you measure

Microstate - full detail

Multiplicity W

All microstates equally likely

Disorder = many microstates

Entropy S

W_AB = W_A x W_B

S_AB = S_A + S_B

Logarithm turns x into +

S = k ln W

Boltzmann constant k

Coin example - binomial C of N,n

Hinglish (regional understanding)

Intuition Hinglish mein samjho

Dekho, entropy ko log "gandagi" ya "disorder" bolte hain, lekin asli matlab hai ginti — kitne tareeke se andar ki cheezein arrange ho sakti hain jabki bahar se sab same dikhe. Ek macrostate (jo tum measure karte ho, jaise temperature ya "3 heads") ke andar bahut saare microstates (har coin ka exact head/tail, har molecule ki exact position) ho sakte hain. Yeh ginti hi WW hai, aur Boltzmann kehte hain S=kln⁡WS = k\ln W.

Ab ln⁡\ln kyun? Kyunki jab do alag systems jodte ho, microstates multiply hote hain (WA×WBW_A \times W_B), par entropy ko add hona chahiye (do same gas boxes = double entropy). Sirf logarithm hi multiplication ko addition mein badalta hai: ln⁡(xy)=ln⁡x+ln⁡y\ln(xy)=\ln x + \ln y. Bas isi mathematical zaroorat se ln⁡\ln aaya, magic nahi.

Second law bhi isi se samajh aata hai: nature kisi cheez ko "force" nahi karti. Har microstate equally likely hai, par high-WW wala macrostate ke paas itne zyada microstates hote hain ki system almost hamesha wahi pe pahunch jaata hai. Jaise LEGO ko hilao to bikhre hue hi milenge — tower banane ka sirf ek tareeka hai, bikharne ke crore. Free expansion mein gas double volume mein faili to ΔS=Nkln⁡2\Delta S = Nk\ln 2 — yahi statistical aur classical dono se nikalta hai, dono match karte hain.

Ek important galti se bacho: WW double karne se SS double nahi hota, sirf kln⁡2k\ln 2 badhta hai. SS system ke size NN ke saath linear badhta hai kyunki WW to NN mein exponential (∼aN\sim a^N) hota hai aur ln⁡\ln usse seedha kar deta hai. Yaad rakho: count the microstates, tidiness ko aankh se mat aankna.

Go deeper — visual, from zero

D1FoundationsEvery symbol from zero · 1,886 wordsD2Visual walkthroughThe derivation in pictures · 2,084 wordsD3Worked examplesEvery scenario covered · 2,976 wordsD4ExercisesGraded, full solutions · 2,368 wordsD5Question bankConcept traps, quick reveals · 1,912 words

Test yourself — Thermodynamics

L1 RecognitionL2 RecallL3 ProductionL4 ApplicationL5 Mastery

Connections

Second law — Kelvin-Planck statement, Clausius statementPhysics · 1.7.18Maxwell-Boltzmann distribution — full derivationPhysics · 2.4.13Entropy and information gainAI-ML · 2.3.2Third law of thermodynamics — S → 0 as T → 0Physics · 1.7.25