1.3.1 · D3Probability & Statistics

Worked examples — Sample spaces, events, and axioms of probability

2,282 words10 min readBack to topic

The scenario matrix

Every problem this topic can throw falls into one of these case classes. The examples below are labelled with the cell they cover.

Cell Case class What makes it tricky Covered by
C1 Disjoint events (Axiom 3 directly) events cannot overlap → just add Ex 1
C2 Overlapping events (inclusion–exclusion) must subtract the overlap once Ex 2
C3 Complement / "at least one" count the opposite, subtract from 1 Ex 3
C4 Degenerate: and probability exactly 0 and exactly 1 Ex 4
C5 Non-uniform space (data / ML) outcomes NOT equally likely Ex 5
C6 Monotonicity / subset bound Ex 6
C7 Real-world word problem translate English → sets first Ex 7
C8 Exam twist: three events / limiting behaviour inclusion–exclusion for 3 sets, and a limit Ex 8

Figure 1 is our master picture of these ideas: a sample space (the outer box) holding two events and that overlap. The red lens is exactly the overlap — the part that inclusion–exclusion (Example 2) must subtract so it is counted only once. Keep this picture in mind: every worked example below is a special case of "which dots are shared, which are separate?"

Figure — Sample spaces, events, and axioms of probability

Example 1 — Disjoint events (cell C1)

Forecast: guess the answer before reading on. Add up the pieces?

  1. Check overlap. . In the Figure 1 picture, these are two circles with no red lens between them. Why this step? Axiom 3 (add probabilities) only applies when events cannot both happen. We must confirm no shared dot before adding.
  2. Single-outcome probabilities. Fair die ⇒ each face has . So , . Why this step? Classical probability: holds because every outcome is equally likely.
  3. Add. . Why this step? Disjoint ⇒ Axiom 3 gives a clean sum, no correction.

Example 2 — Overlapping events (cell C2)

Forecast: if you just add you will be wrong — why?

Figure 2 shows the full grid of dice outcomes: the black strip is event (first die ), the red cells are event (sum ), and the one shaded red cell where they meet is the overlap — the concrete version of the red lens in Figure 1.

Figure — Sample spaces, events, and axioms of probability
  1. Count . First die with any second die: , so . Why this step? Enumerate favourable dots so the classical formula applies.
  2. Count . Sum : , . Why this step? Same enumeration; these are the red cells lying along the sum-10 diagonal in Figure 2.
  3. Count the overlap . "first die 6 AND sum 10" needs second die : only . So . Why this step? is the single cell that Figure 2 shows in both the black strip and the red diagonal — it would be counted twice if we naively added.
  4. Inclusion–exclusion. Why this step? Subtracting the overlap once removes the double-count. This is derived from the axioms, not a new rule.

Example 3 — Complement / "at least one" (cell C3)

Forecast: the direct count is fiddly. Is there a lazier route?

  1. Name the complement. Let "at least one 6". Then "no die shows a 6". Why this step? "At least one" is awkward to count directly; its opposite ("none") is a clean product.
  2. Count . Each die avoids 6 in ways, independently laid out: dots ⇒ . Why this step? The "no 6" region is a clean block in the grid — easy to size.
  3. Complement rule. . Why this step? and are disjoint and fill , so (Axioms 2 + 3).

Example 4 — Degenerate: impossible and certain (cell C4)

Forecast: two of these are "obvious" — but can you prove the 0?

  1. (a) Impossible event. , so the event is . . Why this step? An outcome outside the box contributes no dots.
  2. (b) Certain event. "between 1 and 6" is all of . By Axiom 2, . Why this step? SOMETHING must happen — total certainty is 1 by definition.
  3. (c) Prove . Note and (disjoint). Axiom 3: . Subtract from both sides ⇒ . Why this step? We never assume the impossible event has probability 0 — it follows from Axioms 2 and 3.

Example 5 — Non-uniform space, ML flavour (cell C5)

Forecast: the outcomes are not equally likely — does the classical formula still work?

  1. Frequency = probability estimate. With data-driven (non-symmetric) spaces we use relative frequency: . Why this step? No symmetry justifies equal weights; instead each estimate is (count in event)/(total observations). This is maximum likelihood estimation (MLE) — the "most-supported-by-data" guess — for a Bernoulli space; see Maximum Likelihood Estimation.
  2. Joint event count. "spam AND missed" is the intersection of two conditions: emails satisfy both, so . Why this step? We count only the dots satisfying both conditions, over the same total 1000. Note this is a joint probability , not a conditional — conditional probability rescales by a smaller total and is treated in Conditional Probability.
  3. Consistency with axioms. (Axiom 2 holds); every estimate (Axiom 1). Why this step? Even data-driven probabilities must obey Kolmogorov's axioms, or the model is incoherent.

Example 6 — Monotonicity / subset bound (cell C6)

Forecast: which is bigger, and why must it be bigger — not just "it looks bigger"?

  1. Show the subset. Every outcome in (sum 11) also has sum at least 11, so ; and has the extra dot . Why this step? Monotonicity needs a genuine subset relation, established by inspecting the dots.
  2. Split into disjoint pieces. Write , where is "the extra stuff in not in ". These two pieces share no dot: . Why this step? To use Axiom 3 (add probabilities) we must first break into non-overlapping parts.
  3. Apply the axioms. By Axiom 3, . By Axiom 1, . Adding a non-negative amount cannot decrease the value, so . Why this step? This is the whole proof of monotonicity — it is forced by additivity plus non-negativity, not assumed.
  4. Numbers. , , and the extra piece . Why this step? Concrete counts confirm the strict gap here: .

Example 7 — Real-world word problem (cell C7)

Forecast: English says "either… or…". Which set operation is that, and do the events overlap?

  1. Translate to sets. "either sick or flagged" . Given numbers: , , . Why this step? Word problems fail when solved in English; convert to first.
  2. Overlap is non-zero. , so the events overlap — inclusion–exclusion is required. Why this step? If we forgot this we'd double-count the flagged-and-sick patients.
  3. Apply inclusion–exclusion. Why this step? Subtracting the overlap once gives the correct union.

Example 8 — Exam twist: three events + a limit (cell C8)

Forecast: part (a) has three overlaps and one triple-overlap — miss one and you're off.

  1. (a) Sizes. , over . Why this step? List favourable outcomes so the classical formula applies uniformly.
  2. (a) Pairwise overlaps. (); (); (). Triple (). Why this step? The 3-set rule subtracts every pair once, then adds back the triple to fix over-subtraction.
  3. (a) Three-set inclusion–exclusion. Why this step? singles pairs triple is the pattern that lands each dot with net weight exactly 1.
  4. (b) Limit via complement. . So . As , , so the probability . Why this step? "At least one" again begs the complement; the limiting behaviour shows the probability approaches but is defined by the axioms at every finite .

Recall Self-test

When may you use with no correction? ::: Only when (disjoint), i.e. Axiom 3 applies directly. Why subtract in inclusion–exclusion? ::: To remove the overlap that was counted in both and (avoid double-counting). How do you prove ? ::: disjoint ⇒ . Why does force ? ::: Write disjoint; Axiom 3 gives , and by Axiom 1. Why can't you assume equally likely outcomes for weather? ::: Equal weights need symmetry; asymmetric real-world spaces need data or a model instead.

See also: Random Variables, Probability Distributions, Classification Metrics, Entropy and Information.