4.9.4 · D3Probability Theory & Statistics

Worked examples — Expected value, variance, standard deviation — properties

2,122 words10 min readBack to topic

This page is a drill through every case the properties of expected value, variance and standard deviation can throw at you. Before we solve anything, we lay out a map of all the case classes so you can see that nothing is left out. Then every worked example is tagged with the map cell it covers.

If a symbol here is unfamiliar, it was built in the parent note — but we re-anchor each one as we use it, from zero.


The scenario matrix

Read this as: "what could possibly change from problem to problem?" Each row is a distinct kind of situation. Our examples below are chosen so that every row gets hit at least once.

# Case class What is tricky about it Covered by
A Positive scale, shift (, ) shift must vanish, scale squares Ex 1
B Negative scale () SD uses ; sign traps Ex 2
C Zero scale / degenerate constant () variance collapses to Ex 3
D Sum of independent variables covariance term dies Ex 4
E Sum of dependent variables (incl. ) must keep Ex 5
F Limiting behaviour (Bernoulli spread vs ) where is spread biggest/zero? Ex 6
G Real-world word problem (units, money) translate words → symbols Ex 7
H Exam twist — average of i.i.d. (shrinking spread) connects to big theorems Ex 8

We will lean on three tools. Here they are in one place, each with the question it answers:

Here means the average value (balance point) of ; is the average squared distance from that balance point; brings us back to ordinary units; and measures how two variables move together.

Our running character is the fair die: , each with probability . From the parent note we already know its two summaries:

The picture below is the whole idea of stretch-and-slide on a mass distribution — keep it in your mind for the first three examples.

Figure — Expected value, variance, standard deviation — properties

Example 1 — Cell A: positive scale + shift


Example 2 — Cell B: negative scale (the sign trap)


Example 3 — Cell C: zero scale / degenerate constant


Example 4 — Cell D: sum of independent variables


Example 5 — Cell E: dependent sum, including


Example 6 — Cell F: limiting behaviour (where is spread maximal?)

Figure — Expected value, variance, standard deviation — properties

Example 7 — Cell G: real-world word problem (money & units)


Example 8 — Cell H: exam twist (average of i.i.d.)


Recall

Recall One-line answers to the whole matrix

Shift in ? ::: Always vanishes — spread is shift-invariant. Scale in ? ::: Multiplies by ; in SD by . of a constant? ::: Exactly (degenerate). for independent ? ::: . ? ::: , not . Where is Bernoulli spread largest? ::: At , value ; zero at . of the average of i.i.d.? ::: ; SD shrinks like .