4.9.7 · D5Probability Theory & Statistics

Question bank — Continuous random variables — PDF, CDF, percentiles

1,682 words8 min readBack to topic

Quick symbol reminder so nothing is used before it is named:

  • = the probability density function (PDF) — "how thickly probability is spread at ." Its height is density, its area is probability.
  • = the cumulative distribution function (CDF) — "how much probability sits at or below ," the area of scooped from the far left up to .
  • = the ==-th percentile==, the value solving .
  • Support = the set of where ; outside it .

True or false — justify

A PDF value can be larger than 1.
True. is a density, not a probability; only the area under it must total 1. E.g. on reaches , and on is fine since its area is .
For a continuous RV, for every constant .
True. A single point is an interval of width zero, so . Probability lives in areas, and a line segment has no area.
Because , the event is impossible.
False. Zero probability is not the same as impossible — does land on some exact value every trial. "Impossible" (empty event) and "probability zero" coincide only for discrete variables, not continuous ones.
for a continuous RV.
True. The endpoints and each carry zero probability, so including or excluding them changes nothing. The vs distinction is irrelevant here.
The CDF can be greater than 1 somewhere.
False. is a probability, so always. It rises from up to and never overshoots — that's the total-area-equals-1 axiom seen through accumulation.
is always non-decreasing.
True. Moving rightward adds more area under , and since that added area can never be negative. So can flatten (where ) but never drop.
If is flat on an interval, then there.
True. By the FTC , and a flat stretch has slope zero, so the density is zero there — no probability is being accumulated on that interval.
Every non-negative function is a valid PDF.
False. Non-negativity is necessary but not sufficient; the total area must also equal exactly 1. E.g. on is non-negative but has area .
The median always equals the mean for a continuous RV.
False. They coincide only when the density is symmetric about its centre. For a skewed density (like the exponential) the mean is pulled toward the long tail while the median stays where half the area sits.
If two RVs have the same median, they have the same distribution.
False. The median pins down one point where ; infinitely many different shapes of can share that single crossing while differing everywhere else.
must be continuous for to be a continuous RV.
False. "Continuous RV" refers to taking a continuum of values (so is continuous with no jumps). The density itself may have jumps — e.g. the uniform density is a flat block with sudden drops at its edges. See Uniform distribution.

Spot the error

"Since for , the probability that is ."
Error: reading probability off the height. is a density, and it even exceeds 1, which a probability never can. ; probability is the area, not the height.
"To find the 90th percentile I solve ."
Error: using instead of . A percentile is an accumulated quantity, so solve . The density value at a point tells you nothing directly about how much probability lies below it.
" everywhere for on ."
Error: forgetting the support. only on ; below the support and above it . A CDF must reach 0 to the far left and 1 to the far right.
"."
Error: subtracting the wrong function. Interval probability is , i.e. difference of the CDF (the antiderivative), not of the density . You subtract accumulated areas, not heights.
"For on , the CDF is ."
Error: sign and boundary. Integrating gives . The proposed answer decreases from 1 to 0, violating the non-decreasing rule — a clear signal of the flipped sign. See Exponential distribution.
"Because , the maximum of must be at most 1."
Error: confusing total area with peak height. A tall, narrow spike can have height yet still enclose area 1. Nothing caps the height of a density; only the total area is fixed.
"The 100th percentile is the largest value can take, so gives it."
Error: percentiles need . For distributions with unbounded support (like the exponential), has no finite solution — the "100th percentile" is . Percentiles are defined strictly inside .

Why questions

Why do we use density instead of probability for continuous variables?
Because there are infinitely many exact values, each single value must carry probability 0; a density lets us describe how the total probability of 1 is spread out so intervals still get positive probability via area.
Why must a PDF integrate to exactly 1, not just to something finite?
The total area is the probability that takes some value, which is a certainty — probability 1. A finite-but-not-1 area would mean the probabilities don't sum to certainty.
Why is ?
By the Fundamental Theorem of Calculus, the derivative of an accumulated area is the rate at which area is being added — and that rate is exactly the density. See Fundamental Theorem of Calculus.
Why is invertible for a continuous RV with on its support?
Where , is strictly increasing, so each probability level is hit at exactly one . That unique crossing is what makes well-defined. See Quantile function and inverse-transform sampling.
Why can't we just add up over all like we do for discrete variables?
Each term is 0 and there are uncountably many of them; the sum is meaningless. Integration of a density replaces the sum, letting an uncountable collection of zero-probability points still build up positive interval probabilities. See Discrete random variables — PMF.
Why does the normal distribution use for percentiles instead of a neat formula?
Its CDF has no elementary closed form, so (and z-scores) must be found by tables or numerics rather than algebra. See Normal distribution.
Why does the expectation use rather than ?
Expectation weights each value by its density of probability there, and is that density; is accumulated probability, the wrong weighting. See Expectation and Variance of continuous RVs.

Edge cases

What is far to the left of the support and far to the right?
(no area scooped yet) and (all the area collected). These limits are forced by the total-area-equals-1 axiom.
What happens to as ?
It shrinks to . This is exactly why a single point (the width-zero interval) has probability zero.
Can a valid PDF be zero on part of its stated range?
Yes. The density may vanish on gaps within an interval; those gaps just contribute no probability. Only the total area over the whole line must be 1.
For the exponential , what is ?
Exactly 0, because the support is and for negative . Always check where the density is defined before integrating.
Is continuous at the edges of a uniform distribution even though jumps there?
Yes — ramps up smoothly (a straight line) with no jumps; the slope of jumps (matching 's jumps), but itself stays continuous because no single point carries mass.
What is the median of a distribution whose density is symmetric about ?
Exactly : symmetry puts equal area on each side of the centre, so . Here median and mean coincide (as for the Normal distribution).
If only on a single point, is that a valid PDF?
No. A single point has width zero, so its area is 0, not 1 — you cannot pack the required total probability onto a zero-width set with any finite density.

Recall One-line self-test

Cover every answer above and re-derive the justification, not just the verdict — if you can only say "true/false" you haven't learned the trap.

Connections