4.9.9 · D1Probability Theory & Statistics

Foundations — Chi-squared, t, F distributions — definition, degrees of freedom

1,873 words9 min readBack to topic

This page assumes you know nothing. We will name every squiggle the parent note uses, draw the picture behind it, and say why the topic cannot live without it. Read top to bottom — each item leans on the one above.


1. A random variable, and ("is distributed as")

The wiggle is read "is distributed as". It does not mean "approximately equal". It means "the chance-behaviour of the left side is described by the recipe on the right."

WHY the topic needs it: the whole chapter is a catalogue of histogram-shapes (, , ) and the rule for which shape a computed quantity obeys.


2. The normal distribution and its two dials

Figure — Chi-squared, t, F distributions — definition, degrees of freedom

Look at the figure. The peak sits at . Move and the whole bell slides sideways. The distance from the centre to the "shoulder" (where the curve bends) is exactly . A bigger flattens and widens the bell; a smaller makes it tall and narrow.

WHY the topic needs it: the parent note builds everything from normals. To understand it we must first be fluent in what "centre" and "spread" mean visually.

See Standard Normal Distribution for the fully-detailed treatment.


3. The standard normal — the single Lego brick

WHY the topic needs it: if we always convert to , we only ever need one table / one shape as the raw ingredient. , , are all " cooked three different ways."


4. Expectation — the long-run average

Two facts we'll lean on hard:

For the standard normal, (it's centred at 0) and (proved in the parent note). Keep these two numbers — they seed every mean formula in the chapter.


5. Variance and the independence rule

The second form ("mean of the square minus square of the mean") is the workhorse the parent uses to get .

WHY the topic needs it: degrees of freedom counts independent pieces. No independence, no clean df.


6. Squaring a normal: and where begins

Figure — Chi-squared, t, F distributions — definition, degrees of freedom

Look at the figure: the symmetric bell of (top) becomes the lopsided, always-positive shape of (bottom). Squaring folds the negative half onto the positive half and stretches the tail. Summing of these independent squares is the definition of .

WHY the topic needs it: literally is a sum of squared 's. You cannot read its definition without being comfortable that always and has a skewed shape.


7. Degrees of freedom — counting free pieces

The rule to memorise: df = (number of data points) − (number of parameters you estimated from them). This is the single most-tested idea in the topic.

See Sample Variance and Bessel's Correction for the story in full.


8. The sample tools: , , , and

WHY the topic needs it: and in practice are made of and ; the whole reason exists is that we must use the random in place of the unknown true .


9. The three assembled symbols at a glance

Now every ingredient is defined, the parent's headline objects read cleanly:

The fraction bar, the square root , and division here are ordinary school arithmetic — the only new content was steps 1–8. That is the point of this page: once the bricks are named, the buildings are simple.


Prerequisite map

Random variable and the wiggle means distributed as

Normal N with centre mu and spread sigma

Standard normal Z centred 0 spread 1

Expectation E the long run average

Variance Var the spread

Square a normal gives Z squared

Independence lets variance add

Degrees of freedom count free pieces

Sample tools n xbar s squared

Chi squared t and F distributions

Each foundation flows into the next; the bottom node is the parent topic Chi-squared, t, F distributions — definition, degrees of freedom. The Central Limit Theorem — Central Limit Theorem — is why is normal in the first place, and the shape is a special case of the Gamma Distribution. These distributions then power Hypothesis Testing and ANOVA.


Equipment checklist

Cover the right side; can you answer before revealing?

What does read as, in words?
" is distributed as a normal with centre and variance ."
What are the two dials of a normal and what does each control?
sets the centre (peak position); sets the spread (width).
How do you turn any normal into a standard normal ?
— recentre by subtracting , rescale by dividing by .
What are and for a standard normal?
and .
Give the two-term formula for variance.
.
When may you add two variances?
Only when the two variables are independent.
Why does squaring appear in ?
To measure size of deviation regardless of sign and to weight big misses more — always non-negative "total wobble."
Define a degree of freedom in one sentence.
One independent number still free to vary after all constraints are applied.
State the df rule.
df = (number of data points) − (number of parameters estimated from them).
Why does divide by not ?
Computing forces — one constraint, so one df is lost.
What does mean?
Add up all the values through .