4.9.14 · D5Probability Theory & Statistics
Question bank — Transformations of random variables — change-of-variable technique
True or false — justify
The Jacobian factor can be ignored if you only care about the shape of .
False — the Jacobian is a function of , so it reshapes the density; e.g. for the factor is exactly what creates the blow-up near , which is shape, not just a constant.
For a linear map the Jacobian is a constant, so it only rescales but never changes the shape of the density.
True — is constant in , so is just shifted by , stretched by , and scaled in height by ; the family (e.g. normal) is preserved.
If is monotonic, .
False — you need the derivative of the inverse, , so it should be divided by , not multiplied; multiplying by inverts the stretch factor.
Applying change-of-variable to a discrete random variable requires the Jacobian too.
False — discrete masses just relabel: with no stretch factor, because there is no "length" to dilute; the Jacobian is purely a density phenomenon.
The formula reduces to the single-branch formula when is monotonic.
True — a monotonic has exactly one root for each , so the sum has one term and collapses to .
If two random variables have the same MGF, then any smooth transformation of them produces the same distribution.
True — equal MGFs mean identical distributions, and applying the same deterministic to identically distributed inputs gives identically distributed outputs.
For with , dropping the branch still gives a valid density because it integrates to 1.
False — dropping the branch halves the density everywhere, so it integrates to , not 1; both symmetric branches pour mass into the same .
The change-of-variable output is guaranteed to integrate to 1 if you did every step correctly.
True — conservation of probability mass means ; a failed normalization check is a reliable signal of a missing Jacobian or branch.
Spot the error
" so ."
The error is the missing absolute value; it must be , otherwise for the density comes out negative, which is impossible.
", ; since cube is not one-to-one I must sum over roots."
The error is calling non-injective — cubing is strictly increasing over all reals, so there is exactly one real root and only one branch.
" with standard normal; the inverse is , so for ."
Two errors: absolute value is non-monotonic with roots , and the Jacobian per branch must multiply each; the correct answer is for .
"For the support of is all reals since ranges over all reals."
The exponential maps onto , so for ; forgetting to restrict the range assigns density where no mass can land.
", ; roots are and both are in the support, so I sum two equal terms."
This one is actually correct — both lie in , so summing both branches is right; the trap is that it looks like the earlier "one-sided" uniform case where only was valid.
"To transform a bivariate density I use where is the Jacobian of the forward map ."
The formula uses the Jacobian of the inverse map ; using the forward one gives the reciprocal area-factor, off by unless you take the reciprocal.
", ; since tan repeats every I must sum infinitely many branches."
On the restricted domain , tan is strictly increasing and one-to-one, so there is a single branch; the periodicity only matters if the support spans multiple periods.
Why questions
Why does the change-of-variable formula go through the CDF rather than manipulating densities directly?
The CDF is always well-defined and monotone even where a density is awkward, and differentiating delivers the Jacobian automatically via the chain rule — no hand-waving about "" needed.
Why does the density for , blow up at yet still integrate to 1?
An integrable singularity: , so infinite height over a vanishingly thin sliver still holds finite mass — squaring compresses many small into a tiny -neighborhood.
Why must the Jacobian carry an absolute value when the raw derivative of a decreasing inverse is negative?
Densities are nonnegative mass-per-length; the sign of only records direction of the map, and the inequality flip in the CDF derivation already handles orientation, leaving the magnitude as the true stretch factor.
Why does squaring a standard normal give the chi-square with 1 df rather than some other distribution?
The mechanism is forced: two symmetric normal branches feed each , and the shape combined with the Jacobian produces exactly , which is the density by definition.
Why does inverse-transform sampling use with ?
Because is uniformly distributed for any continuous ; running that backwards, feeding a uniform into reconstructs the target distribution exactly — a direct application of change-of-variable with .
Why can't we always find a closed-form even when the change-of-variable formula "applies"?
The formula needs a computable inverse and its derivative; if has no elementary inverse (e.g. ), the Jacobian and density exist but cannot be written in closed form.
Why is LOTUS often preferable when you only want rather than the full distribution of ?
LOTUS computes directly with no inversion or Jacobian; the change-of-variable machinery is only worth invoking when you genuinely need itself, not a single number.
Edge cases
What happens to change-of-variable when is constant, say always?
It breaks down — has no inverse and is degenerate (a point mass at 5), so no density exists; change-of-variable requires to be non-constant and invertible on the support.
What if is monotone but has a flat spot (derivative zero) at one point, like at ?
The inverse has infinite at , so may spike there; the formula still holds pointwise for , and the single measure-zero point does not affect probabilities.
For where (entirely negative), which branch survives?
Only lies in the support, so despite the square being non-monotonic in general, on this domain it is one-to-one and you use a single branch — always intersect roots with the actual support.
What is for outside the range of ?
Exactly zero — no in the support maps there, so no mass can arrive; forgetting this is the most common way a "valid-looking" fails to integrate to 1.
If is discrete and is many-to-one, how do probabilities combine?
You sum the point masses of all mapping to a given : — the discrete echo of "sum over branches," but with masses, not densities.
What if the transform mixes a continuous and a discrete piece, e.g. with continuous?
becomes a mixed variable: a point mass at (all pile up) plus a continuous density for ; pure change-of-variable handles only the continuous part, and you treat the atom separately.
For a bivariate map that is invertible everywhere except on a curve of measure zero, is still usable?
Yes — a measure-zero exceptional set carries no probability, so the Jacobian determinant formula holds almost everywhere and the density is unaffected by the excluded curve.