1.3.21 · D1Probability & Statistics

Foundations — Confidence intervals

2,187 words10 min readBack to topic

Before you can read the parent note's derivation, you need every letter and squiggle it uses to mean something concrete. Below we build each one from nothing, in the order they depend on each other. Nothing is used before it is drawn.


1. Population vs. Sample — the two worlds

Everything in this topic lives in a tension between two things: the whole world we cannot fully see, and the tiny scoop we actually measured.

Look at the figure: the big cloud on the left is the population (thousands of dots). The little circle on the right is your sample — just a few dots you happened to grab. The whole game of confidence intervals is: guess a fact about the big cloud using only the little circle.

Why the topic needs this: every symbol below is tagged as either a population fact (hidden, fixed, usually Greek letters) or a sample fact (measured, changes each scoop, usually Latin letters). Keeping these two worlds separate is the single most common thing beginners mix up.


2. — the true mean (the fish we hunt)

The picture: on the big cloud, is the exact centre of balance — the one spot where the cloud would perfectly balance on a pin.

Why the topic needs it: is the fish we are trying to catch. The entire confidence interval exists to bracket this one hidden number. Because it is fixed, we never say "the probability is here" — doesn't move.


3. and — how spread out the world is

The picture shows two bell-shaped clouds with the same centre but different widths. The narrow one has small (everyone close to average); the wide one has large (values scattered far). is literally the typical distance from the middle.

Why the topic needs it: a confidence interval's width grows with . If the world is very spread out, your net must be wider to be trustworthy. We square then square-root so that distances above and below don't cancel out — squaring kills the minus signs.


4. and — the average you actually computed

Let's decode that formula symbol by symbol, because the parent note uses it constantly:

The picture for : on your little sample circle, is its balance point — the sample's own centre. It is our best single guess for the hidden , but it wobbles.


5. — sample size (how big your scoop is)

Why the topic needs it: is the knob you can actually control. It appears as in the denominator of the interval width, so measuring more shrinks your net. This is the entire reason "more data = more confidence."


6. Random variable & distribution — why one average has a shape

The figure: imagine repeating "grab a fresh sample, compute " thousands of times. Each is a dot. Pile them up and you get a bell shape centred on . This pile is the sampling distribution of the mean. Crucially, it is narrower than the raw data cloud — averages jitter less than individual measurements.

Why the topic needs it: the whole derivation asks "how far can stray from ?" That question is answered by the shape of this bell. No distribution, no interval.

This bell being normal (for large ) is exactly what the Central Limit Theorem guarantees — the parent leans on it, and it deserves its own study.


7. The normal distribution

Note the width : the sample-mean bell has the population spread shrunk by dividing by . That's the maths behind "averages jitter less" — bigger , tighter bell.


8. — the standardized ruler

Why the topic needs it: we know exact cut-off points on the one standard bell. By converting to , we borrow those universal cut-offs for any problem. This is the "standardize to control probability" step in the parent.


9. , , and — confidence and its critical value

The picture: the standard bell with two small shaded tails, each holding area . The vertical lines where the shading starts are at . The unshaded middle holds of the area — that's the region we trust.


10. Standard error — the spread of the guess itself

Why and not ? Variance divides by ; standard deviation is its square root, so the spread divides by . This is exactly why quadrupling your data only halves your error — see Standard Error for the full story.


11. , , and the t-distribution — coping when is unknown


Prerequisite map

Population vs Sample

mu the true mean

x-bar the sample mean

sigma the spread

Random variable and distribution

Normal distribution

Z standardized ruler

Standard error

Critical value z alpha over 2

s and t-distribution

Confidence Interval


Equipment checklist

Cover the right side; you're ready when each reveal matches your own answer.

What separates from ?
is the fixed hidden population mean; is the wobbling average of one sample.
Is random?
No — it is a fixed unknown constant, like a key whose location you don't know.
What does literally instruct?
Add measurements from the 1st to the -th.
Why square the deviations in variance?
So above-and-below distances don't cancel to zero.
What is the sampling distribution of the mean?
The bell-shaped pile of values you'd get by re-sampling many times.
Why is that bell narrower than the raw data?
Its variance is — averages jitter less than individuals.
What does say in words?
The sample mean is bell-shaped, centred at , with variance .
What does a z-score of mean?
The value sits two standard deviations above the centre.
Why is the critical value written and not ?
The miss is split evenly between the two tails, each.
What does the standard error measure?
The typical distance between and .
Why divide by in ?
One degree of freedom was used up estimating (Bessel's correction).
When do we switch from normal to the t-distribution?
When is unknown and estimated by , especially for small .

Next: return to the parent note and watch every one of these symbols slot into the derivation. Prefer Hinglish? See 1.3.21 Confidence intervals (Hinglish). Deeper roads: Central Limit Theorem, Standard Error, Hypothesis Testing, Bootstrap Methods.