2.7.3 · D5Statistics & Probability — Intermediate

Question bank — Measures of dispersion — variance, standard deviation

2,104 words10 min readBack to topic

The vocabulary these traps rely on

Before a single trap, let us pin down every symbol so nothing sneaks up on you.

In Figure s01 the yellow dashed line marks the mean (the balance point), and each coloured stick is a deviation : sticks pointing left are negative, sticks pointing right are positive. Notice with your eye that the left-lengths and right-lengths balance out — that is the picture behind "", and it is why we must square before averaging.

Why — derived, not just quoted

The shortcut is not magic. Start from the definition and expand the square inside: Split the one sum into three (summation distributes over ): The middle piece is and the last is , so

Three quick anchors to carry into the traps:

  • Variance — average squared distance from the centre, never negative.
  • Standard deviation — the same idea in the data's own units.
  • The shortcut — "mean of squares minus square of mean".

True or false — justify

Each line is a claim. Decide true or false and give the one-sentence reason before revealing. A bare "true"/"false" is worth nothing — the reason is the point.

Variance can be negative if the data has more values below the mean than above.
False. Every term is a square, so it is ; a sum of non-negative numbers divided by can never be negative, no matter how the data sits around the mean.
If two datasets have the same mean, they must have the same variance.
False. The mean fixes the centre only; the parent note's whole point is that two classes averaging 60% can be tightly bunched or wildly scattered — same mean, different spread.
Standard deviation is always less than or equal to the variance.
False. Only when . If then ; square-rooting a number below 1 makes it bigger.
Adding 10 to every exam mark raises the standard deviation by 10.
False. Shifting every value slides the whole cloud sideways without changing any gap between points, so both variance and SD are unchanged — variance is shift-invariant.
Doubling every data value doubles the variance.
False. Scaling by multiplies variance by , so doubling () multiplies variance by ; it doubles the SD, not the variance. See Figure s03 for the stretch picture.
and are just two names for the same number.
False. squares each value then averages; averages then squares. Their difference is exactly the variance, so they are equal only when variance is (all values identical).
If variance is , the mean, median and mode of the data must all be equal.
True. Variance forces every value to be identical, so a single repeated number is simultaneously the mean, the median and the mode.
Sample variance is always larger than population variance for the same data.
True (for and non-constant data). Both share the same sum of squared deviations, but divides by the smaller , so it is larger; if all values are equal both are .

Figure s03 shows why the scaling rule squares : stretch the number line by and every deviation stick stretches by , so every squared stick — and therefore their average, the variance — stretches by , while the SD (a length again) stretches by just .


Spot the error

Each line describes a calculation or statement someone actually made. Find the mistake and state the correct principle.

"I got variance marks, so the spread is about marks."
The error is units. Variance is in marks², not marks; the interpretable spread is marks. Report SD, not variance, for a spread in real units.
"I averaged the deviations and got , so this data has no spread."
The error is skipping the square. for every dataset because positives and negatives cancel (see Figure s01); that zero measures nothing about spread. You must square first.
"For I used , so variance ."
The error is confusing with . Here while , so variance , not .
"My data is the entire population of 5 students, so I divide the sum of squares by ."
The error is applying Bessel's correction to a full population. Divide by only when the data is a sample estimating a bigger population; a whole population uses .
"I computed the mean as , then used a different rounded mean when finding deviations."
The error is using an inconsistent centre. Every deviation must be measured from the same you actually computed, or the sum of deviations won't cancel and the variance is corrupted.
"Variance came out as , which tells me the data trends downward."
The error is that variance is impossible to make negative — a negative result means an arithmetic slip (likely , which can never truly happen). Variance carries no direction/trend information at all.
"Two SDs are cm and cm, so together the combined SD is cm."
The error is adding SDs directly. Standard deviations do not add; even variances only add under independence, and you never combine spreads by simple addition of SDs.

Why questions

State the reason in your own words first, then check.

Why do we square deviations instead of taking absolute values?
Squaring is smooth/differentiable (good for calculus and least-squares), penalises large deviations more heavily, and links cleanly to geometry and the normal distribution — advantages the kink of lacks.
Why is always at least as large as ?
Because their difference is the variance (Figure s02's green gap), and variance is a sum of squares divided by , hence ; so always.
Why does dividing by (instead of ) make the sample variance bigger?
The sample mean is chosen to minimise the sum of squared deviations, so those deviations are on average slightly too small; dividing by the smaller inflates the result to remove that downward bias.
Why does variance ignore adding a constant but square the effect of multiplying?
Sliding every point by leaves all pairwise distances unchanged, so spread is untouched; multiplying by stretches every distance by , and since variance uses squared distances they stretch by (Figure s03).
Why do we bother with SD at all when variance already measures spread?
Variance lives in squared units (marks², cm²) which are hard to interpret; taking the square root returns SD to the original units so a "spread of marks" makes sense.
Why can the range be a poor spread measure compared to variance?
Range uses only the two extreme points and ignores everything in between, so a single outlier controls it; variance uses every value's distance from the centre.
Why is (the coefficient of variation) sometimes preferred over alone?
SD of cm is large for a beetle but tiny for a building; dividing by the mean gives a unitless relative spread — see Coefficient of Variation — that lets you compare scales fairly.

Edge cases

The boundary and degenerate scenarios. If you never met these, you don't fully own the definition.

What is the variance of a single data point (as a population)?
Zero. The mean equals , the only deviation is , so ; one point has no spread.
What is the sample variance of a single data point?
Undefined. The formula divides by , and a single observation gives no information about spread around a population — you cannot estimate it.
Data is . What are the mean, variance and SD?
Mean , variance , SD . All values identical means every deviation is ; this is the unique case where variance hits its minimum.
Data is . Is the variance zero because most values are zero?
No. The mean is , so every point deviates from it; three deviations of and one of give a positive variance. "Mostly zeros" is not "all identical".
If every value is negative, say , can the variance still be positive?
Yes. Variance measures spread, not sign; deviations from the mean are , whose squares give a positive variance. Negative data never forces negative or zero variance.
Two datasets: and . Which has larger SD and why?
The second. The first has all-identical values so SD ; the second has genuine spread around the mean , giving a positive SD.
As for a fixed population, does the gap between the -divisor and -divisor variance matter?
No — the two estimates converge, since ; Bessel's correction only matters noticeably for small samples.
What happens to the SD if you append one point exactly equal to the current mean?
The mean is unchanged but the sum of squared deviations is unchanged while grows, so the variance and SD shrink slightly — adding a point right at the centre dilutes the average spread.
Recall One-line self-test before you leave

Say aloud: variance is never negative, is measured in squared units, is unchanged when you shift all data, and is multiplied by ==== when you scale by . If any of those four surprised you, reread that trap.

Connections