1.3.12 · D1Probability & Statistics

Foundations — Uniform, Exponential, and Beta distributions

1,963 words9 min readBack to topic

This page assumes you know nothing beyond arithmetic and reading a graph. We build every tool the parent uses, in the order it needs them, so no symbol appears before you own it.


1. A number that comes out random: the random variable

Picture: think of a dart landing somewhere on a ruler. Before the throw, the landing spot is . After the throw, "it landed at " is a value .

Why the topic needs it. All three distributions describe what number is likely to come out: a random weight, a random waiting time, a random probability. Without there is nothing to describe.

  • — the little "" reads "is distributed as". It says: "the box follows the recipe on the right." So = " is a Uniform box between and ."

2. The blanket of belief: the probability density

For a continuous box (one that can land on any real number, not just whole numbers), asking "what is the chance equals exactly ?" is hopeless — there are infinitely many points, so any single one has chance . Instead we measure how densely packed the belief is near each point.

Figure — Uniform, Exponential, and Beta distributions

Look at the figure: the shaded amber region between and is the probability that lands in . Its area — not the curve's height — is the number between and .

See Continuous Random Variables and PDFs for the full treatment — here we only need the picture.

Why the topic needs it. Every "PDF formula" box in the parent (, , ) is just the shape of this blanket for that distribution.


3. The tool that measures area: the integral

The moment we said "probability = area," we needed a machine that computes area under a curved top. That machine is the integral. We chose it — not multiplication — because the blanket's height changes as moves, so we can't just do "height × width."

Figure — Uniform, Exponential, and Beta distributions
  • = an infinitely thin sliver of width along the ruler.
  • = "sum the strips from the left edge to the right edge ."
  • The bar rule means "plug in the top edge, subtract the bottom edge." The parent uses this in every derivation.

Why the topic needs it. The Uniform mean , the Beta normaliser , and the check "" are all this same summing machine.


4. The running total from the left: the CDF

Instead of "area over a middle stretch," often we want "area from the far left up to a point " — the total belief that came out at most .

Figure — Uniform, Exponential, and Beta distributions

The staircase-smooth curve in the figure only ever rises. Its height at equals the shaded area to its left in the PDF picture.

Why the topic needs it. The Exponential's and Uniform's are CDFs. Percentile questions ("95th percentile wait time") solve the CDF equation for .


5. The balance point and the spread: and

Why the parent uses . It's the same variance, rearranged so you only need two integrals ( and ) instead of expanding by hand. See Maximum Likelihood Estimation for where means and variances get estimated from data.


6. The number and the exponential

The Exponential distribution is named after this. We need it before the parent uses .

Figure — Uniform, Exponential, and Beta distributions
  • (Greek "lambda") controls how fast it decays: bigger = steeper drop.
  • answers "what fraction of belief is still to the right of time ?" — that's exactly , the chance you're still waiting.
  • (natural log) is the undo button for : . The parent uses it to solve for — take of both sides to bring down from the exponent.

Why the topic needs it. Every Exponential formula (, , memorylessness) rides on this decaying curve. It flows from the Poisson Process, which counts events happening at steady rate .


7. Greek parameters: and the shape knobs


8. The factorial-for-any-number: and the Beta function

Why the topic needs it. Beta lives on to model a probability of a probability. This is the engine of Bayesian Inference and Conjugate Priors and powers Thompson Sampling.


Prerequisite map

Random variable X

PDF f of x: blanket height

Integral: area machine

CDF F of x: running total

Mean and Variance

e and exp decay

Exponential distribution

Gamma and Beta function

Beta distribution

Uniform distribution

Topic 1.3.12

Uniform, Exponential and Beta all feed the topic — and the topic itself feeds Monte Carlo Methods, Xavier and He Initialization, and Bayesian ML downstream.


Equipment checklist

Cover the right side; say your answer aloud; then reveal.

What does read as in plain words?
"The random box is distributed as a Uniform on the interval from to ."
Is a probability or a density? What gives an actual probability?
A density (a height); the area under over a stretch gives the probability.
State the two rules every PDF must satisfy.
everywhere, and .
What does the symbol compute geometrically?
The area under the curve between and , by summing infinitely thin strips.
What does the bar notation mean?
: plug in the top limit, subtract the bottom limit.
What does the CDF represent, and its two end values?
The accumulated area (probability) up to ; it climbs from at the far left to at the far right.
How are the PDF and CDF related?
The PDF is the slope (derivative) of the CDF; the CDF is the accumulated area of the PDF.
Write the integral definition of the mean .
.
Give the shortcut formula for variance.
.
What does represent for a waiting time ?
The chance you are still waiting, ; it decays from toward as grows.
Which function undoes , and why does the parent use it?
The natural log ; used to bring down out of the exponent when solving constant.
What is for a whole number ?
— the factorial, extended to work for non-whole numbers too.
What role does play in the Beta PDF?
It is the area under the raw shape ; dividing by it normalises the total probability to .