4.9.8 · D1Probability Theory & Statistics

Foundations — Common continuous distributions — Uniform, Normal, Exponential, Gamma, Beta

1,918 words9 min readBack to topic

Before you can read a single formula in the parent note, you need to own the alphabet it speaks in. Below is every symbol and idea it uses, ordered so each one leans only on the ones above it. Nothing appears before it is earned.


1. A number line and an interval

Picture it: a horizontal ruler with two vertical fence-posts at and . The region between the posts is where our random quantity is allowed to land.

Why the topic needs it: every distribution lives on some stretch of the line — Uniform on , Exponential on , Beta on . The interval is the stage on which probability is spread.

Figure — Common continuous distributions — Uniform, Normal, Exponential, Gamma, Beta

2. Random variable

Picture it: a pointer that will drop somewhere onto the number line, but you don't yet know where. Different runs of the experiment drop it in different places.

Why the topic needs it: the whole subject is about describing where the pointer tends to land. is the thing; the distribution is the description of 's habits.


3. Probability and area

Figure — Common continuous distributions — Uniform, Normal, Exponential, Gamma, Beta

Why the topic needs it: this single move — probability = area — is the engine of the entire chapter. Every formula is secretly "compute this area."


4. Function and the density idea

Why the topic needs it: is the "shape of the butter smear." Choosing is choosing the distribution.


5. The integral — the area-adder

Figure — Common continuous distributions — Uniform, Normal, Exponential, Gamma, Beta

Why the topic needs it: . Mean, variance, and every normalizing constant are integrals.


6. The CDF and the derivative

Why the topic needs it: the parent derives every distribution by writing down either or and flipping between them with (going up) and (going down).


7. Mean , expectation , and variance

Why the topic needs it: every distribution is summarised by its , and the parent computes both as integrals for all five.


8. The exponential

Why the topic needs it: Exponential, Gamma, and Normal densities all contain an factor; it controls how fast the tails thin out.


9. The Greek and special-function toolbox

Why the topic needs it: these are the normalising constants — the numbers you divide by so the total area equals exactly . Without them a "density" would enclose the wrong amount of butter.


Prerequisite map

Number line and interval a to b

Random variable X

Probability as area

Density function f of x

Integral: area adder

CDF F and derivative F prime

Mean mu and variance

Exponential decay e to minus lambda t

Waiting time laws

Greek and special functions

Normalizing constants

Five distributions


Equipment checklist

Cover the right side and see if you can answer before revealing.

What does the height of a density represent (and what is it not)?
Density = probability per unit length; it is not a probability. Only area under is a probability, so can exceed .
Why do we ask instead of for continuous ?
The chance of hitting one exact real number is ; probability only accumulates over a range, as area.
What single instruction does encode?
"Add up the area under the curve from to ," by summing infinitely thin height-times-width slivers.
Why an integral rather than multiplication for area under ?
The height varies; multiplication needs constant height, so we chop into slivers thin enough to be flat and sum them.
How are the PDF and CDF related in both directions?
(integrate up) and (differentiate down — density is the slope of accumulated area).
What is the mean geometrically, and its integral form?
The balance point of the density; .
Why square the distance from the mean in variance?
So overshoots and undershoots cannot cancel to zero, and larger misses count more.
What does do as grows, and what does control?
Decays smoothly from toward ; larger rate means faster decay.
What job do , , , and all secretly do?
They are normalising constants / area tools ensuring total probability is exactly (and reads off standard-normal areas).