4.9.1 · D2Probability Theory & Statistics

Visual walkthrough — Probability space — sample space Ω, sigma-algebra F, measure P — Kolmogorov axioms

1,934 words9 min readBack to topic

Before any symbol, one promise: everything here is just area. Picture the whole sample space (all things that could happen) as a rectangle whose total area is exactly 1 unit — one liter of paint. An event is a region inside that rectangle. Its probability is the fraction of the paint sitting on it. That single mental image carries the entire page.


Step 1 — The stage: a rectangle of area 1

WHAT. Draw as a rectangle. Call its area . Any event is a blob inside it.

WHY. The three axioms only talk about numbers . To see them we need a picture where those numbers are visible quantities. Area is perfect: it is never negative, it adds when regions don't overlap, and a fixed total can be normalized to . Those are exactly axioms A1, A3, A2 in disguise — so "area" is not a loose analogy, it is a faithful model.

PICTURE. Look at the figure. The whole peach rectangle is ; the magenta blob is .

Figure — Probability space — sample space Ω, sigma-algebra F, measure P — Kolmogorov axioms

Step 2 — The adding rule: disjoint pieces add

WHAT. If two events and never overlap (share no outcome), the area of " or " is just the two areas summed.

WHY. This is axiom A3, countable additivity, drawn in the simplest case. "Disjoint" means the blobs touch nowhere; then covering them with paint uses one blob's worth plus the other's — no paint is counted twice because no region belongs to both.

PICTURE. Two separated blobs; the combined shaded area is literally the sum.

Figure — Probability space — sample space Ω, sigma-algebra F, measure P — Kolmogorov axioms

The full axiom A3 allows infinitely many disjoint pieces to add. We only need the picture with two, but keep in the back of your mind: the rule survives even when you slice into a countable infinity of non-overlapping crumbs.


Step 3 — The empty event carries no paint

WHAT. Show : the region containing no outcomes has zero area.

WHY. It feels obvious, but nothing is obvious until it is forced by the axioms. The trick: the empty region is disjoint from itself and from anything else. So I can stack infinitely many copies of next to and the union is still just .

PICTURE. The rectangle , then a stack of infinitely many zero-width slivers (each a copy of ) that add nothing to the total.

Figure — Probability space — sample space Ω, sigma-algebra F, measure P — Kolmogorov axioms

Step 4 — Splitting the whole: the complement rule

WHAT. Split into a blob and everything outside it, called ("A-complement", the leftover region). Their areas must total .

WHY. and are disjoint (nothing is inside and outside at once) and together they tile the whole rectangle. So the adding rule from Step 2 applies, and the total is pinned to by A2. This is the single most-used rule in all of probability: "chance of not A".

PICTURE. The rectangle cut into a magenta and a violet ; the two colors fill it exactly.

Figure — Probability space — sample space Ω, sigma-algebra F, measure P — Kolmogorov axioms

Step 5 — Nesting: bigger blob, more paint (monotonicity)

WHAT. If sits entirely inside (written ), then cannot have more area than .

WHY. Draw as an outer blob and as an inner blob fully contained in it. The ring between them, (" minus ", the part of outside ), is a genuine region with its own non-negative area. Since is plus that ring, and the ring can't subtract area, is at least as big as .

PICTURE. Nested blobs: inner (magenta), outer , orange ring between them.

Figure — Probability space — sample space Ω, sigma-algebra F, measure P — Kolmogorov axioms

Step 6 — Overlap: why you must subtract (inclusion–exclusion)

WHAT. When and do overlap, adding their areas double-counts the overlap . Fix it by subtracting that overlap once.

WHY. This is the case Step 2 forbade. Pour paint on , then on : the lens-shaped region where they cross (, " and ") gets painted twice. The paint on the union should be counted once, so we remove one copy of the double-counted lens.

PICTURE. Two overlapping blobs; the central lens is shaded darker to show the double count that must be subtracted.

Figure — Probability space — sample space Ω, sigma-algebra F, measure P — Kolmogorov axioms

Step 7 — Degenerate case: a point of zero area that still happens

WHAT. On a continuous stage like , a single point has area , yet it can still occur. "Probability " is not "impossible".

WHY. Shrink a tiny interval around a point down to nothing. Each interval has area (length) , and as grows. The point is the limit of these shrinking intervals, so its area is the limit . But you can land exactly on when you throw a dart at the line — the outcome is real, its area is nil.

PICTURE. A number line with nested intervals collapsing onto the point , their lengths marching to .

Figure — Probability space — sample space Ω, sigma-algebra F, measure P — Kolmogorov axioms

The one-picture summary

Every rule on this page is one statement about area inside a rectangle of total area 1:

  • add disjoint pieces (Step 2),
  • the leftover completes the whole (Step 4, complement),
  • nested means no bigger (Step 5, monotonic),
  • overlap is double-counted, so subtract it (Step 6),
  • and shrinking to nothing gives area (Steps 3 & 7).
Figure — Probability space — sample space Ω, sigma-algebra F, measure P — Kolmogorov axioms
Recall Feynman retelling of the whole walkthrough

Picture a rectangular table top holding exactly one liter of spilled paint — that's with total probability . Any shape you draw on the table is an event, and its probability is just how much paint sits inside it. Rule one: you can't have negative paint. Rule two: the whole table holds all one liter. Rule three: two shapes that never touch — their paint just adds. From only that: an empty shape holds no paint; the paint outside a shape is one liter minus the paint inside; a shape inside a bigger shape can't hold more paint than the bigger one; and if two shapes overlap you painted the overlap twice, so subtract it once. Finally, on a smooth table a single dot has no area at all, so no paint — but your finger can still land on it. That's the whole of basic probability, and it's all just area.

Recall Rapid self-test

Why is forced? ::: Stack infinitely many empties beside ; the union is still , so the pile of terms sums to , and each non-negative term must be . Where does come from? ::: Complement rule with . When does hold exactly? ::: Only when ; otherwise subtract . Does mean can't occur on ? ::: No — probability is "almost never", the point is still a possible outcome.


Connections: parent 4.9.01 Probability space — sample space Ω, sigma-algebra F, measure P — Kolmogorov axioms (Hinglish) · builds toward Conditional probability & independence · Random variables · Inclusion–exclusion principle · Borel sigma-algebra · Measure theory & Lebesgue integration · Expectation and Lebesgue integral.