4.9.5 · D5Probability Theory & Statistics

Question bank — Moment generating function (MGF) — definition, use

1,448 words7 min readBack to topic

Before we begin, one shared vocabulary reminder so no symbol is unearned:


True or false — justify

for every random variable that has an MGF.
True — . It is the free sanity check; if your algebra gives anything else you slipped.
The value in is a possible value of .
False — is a bookkeeping dummy used only to build the power series. It never stands for an outcome of ; we care about derivatives near , not .
If on an open interval around , then and have the same distribution.
True — this is the uniqueness property. The MGF, when it exists near , is a fingerprint that pins down the whole distribution.
Two random variables with the same mean and variance must have the same MGF.
False — mean and variance are just the first two moments; the MGF encodes all moments (skew, tails, …). Distributions can match on two moments yet differ everywhere else.
holds for any two random variables.
False — it needs , because only then does split into . Correlated variables break the split.
Every random variable has an MGF.
False — you need ==finite in an interval around ==. Heavy-tailed variables like the Cauchy have for all , so no MGF exists.
If two independent variables both have MGFs, their sum has an MGF too.
True — on the overlap of their intervals of existence, is a finite product of finite numbers, so it is finite there.
The characteristic function exists for every random variable.
True — because is bounded, the expectation is always finite. That is exactly why the Characteristic Function is the heavier, always-available tool when MGFs fail.
gives the mean of .
False — the mean is . Differentiating and evaluating at is what isolates a single moment; evaluating at mixes them all.
If exists only for (as for the Exponential), then the distribution is not uniquely determined.
False — you only need existence on an interval around , and includes such an interval (both sides of ). Uniqueness still holds.

Spot the error

", so plug in to average , and that's ."
The error is confusing with — they are different quantities. Moments come from derivatives at : , not from evaluating the MGF anywhere.
"For the Exponential, for all real ."
The integral only converges when the exponent is negative, i.e. , so the domain is . Beyond that the MGF is .
" and are both Normal, so automatically."
Being Normal does not grant independence. The product rule needs ; two correlated Normals still add to a Normal but their sum's MGF is not the plain product of the individual MGFs.
"I computed an MGF and got , but the rest looks fine, so I'll keep going."
Stop — must equal since . A value other than proves an algebra error upstream; the rest cannot be trusted.
"The -th moment is the coefficient of in the series of ."
The coefficient of is , not . You must multiply by (equivalently, take the -th derivative at ) to recover the moment itself.
"Binomial MGF: I integrated the pmf against and it was awful, so the MGF is intractable."
No need — a Binomial is a sum of independent Bernoullis, so its MGF is by multiplying the parts. This sidesteps the sum entirely.
" because you can pull constants out of ."
The constant sits in the exponent, not as a multiplier: . Scaling rescales the argument of the MGF, it does not multiply the whole function.

Why questions

Why does — rather than some other function — generate the moments?
Its Taylor Series has sitting on the slot, so taking places on each power of . Each power of acts as a clean "tag" for exactly one moment.
Why do we differentiate and set instead of reading off coefficients directly?
They are the same idea — the -th derivative at is times the coefficient. Differentiating is just the mechanical way to extract that one coefficient without expanding the whole series by hand.
Why does independence turn a sum into a product of MGFs?
Because , and independence lets . So addition of independent variables becomes multiplication of their MGFs — convolution made into arithmetic.
Why is this product rule the reason MGFs shine in the Central Limit Theorem?
Summing i.i.d. variables becomes raising one MGF to the -th power, a manageable object. Showing that this power converges to (the standard Normal's MGF) proves convergence in distribution via uniqueness.
Why does the MGF need to be finite on an interval, not just at ?
At it is trivially for everyone, so that alone says nothing. Only finiteness on a two-sided neighborhood guarantees the derivatives (moments) exist and that the uniqueness fingerprint holds.
Why does Property 1 use out front but inside?
Writing gives . The shift is a constant that factors out as ; the scale lives with , so it rescales the MGF's argument to .
Why is the Cumulant Generating Function often used alongside the MGF?
It is , and taking a log turns the product rule for independent sums into a plain sum of cumulant functions — so cumulants of a sum just add.

Edge cases

What is the MGF of a constant (a degenerate "random" variable)?
. Its derivatives at give , exactly right, and as expected.
For the Exponential, does the MGF exist at even though the domain is ?
Yes — always, and . The domain comfortably contains an interval around .
Can a distribution have all its moments finite yet still have no MGF?
Yes — the Lognormal has finite moments of every order, but for every , so no interval around works. Finite moments do not guarantee an MGF.
What happens to the sum rule if and are the same variable (so )?
Then and are maximally dependent, not independent, so in general. The product rule silently fails.
If for all in a neighborhood of , what is ?
By uniqueness, is the constant : its MGF is . A flat MGF equal to means every moment past the zeroth vanishes.
Does adding a constant change the variance, and does the MGF reflect that?
No — , and only shifts the mean (), leaving unchanged. The MGF correctly encodes shift-invariance of variance.

Recall One-line self-test

Cover the answers above and ask yourself: why , why a product for sums, why an interval? If you can answer all three in a sentence each, you own the MGF.