4.9.15 · D5 · HinglishProbability Theory & Statistics
Question bank — Central Limit Theorem — statement, proof sketch, significance
4.9.15 · D5· Maths › Probability Theory & Statistics › Central Limit Theorem — statement, proof sketch, significanc
True or false — justify
The CLT makes the raw data normal as grows
False. Data apni original shape hamesha ke liye rakhta hai; sirf sampling distribution of the mean or sum (ek derived quantity) normal hoti hai.
The must be normally distributed for the CLT to apply
False. Theorem ki poori power yahi hai ki inputs kuch bhi ho sakti hain — dice, coins, exponentials — bas unka variance finite hona chahiye; normality ek output hai, requirement nahi.
If each is already , then is exactly , not just approximately
True. Independent normals ka sum exactly normal hota hai, toh koi limit chahiye hi nahi — CLT ki approximation har finite ke liye equality ban jaati hai.
The CLT guarantees the sample mean converges to
False — yeh Law of Large Numbers hai. CLT ek finer statement hai ke aas-paas fluctuations ki shape ke baare mein, jab tum unhe se magnify karo.
Doubling your sample size halves your standard error
False. Standard error hai , toh use halve karne ke liye ko quadruple karna padta hai — error ki tarah shrink hoti hai, ki tarah nahi.
The CLT applies to the Cauchy Distribution once is large enough
False. Cauchy ka infinite variance hai (aur defined mean bhi nahi), isliye ek core hypothesis fail ho jaati hai; Cauchy variables ka average kitna bhi bada ho, fir bhi same spread ke saath Cauchy hi rehta hai.
Independence of the can always be dropped as long as is huge
False. Classical CLT ko independence chahiye; strongly dependent variables ek non-normal limit ki taraf converge ho sakte hain ya stabilize hi nahi hote. Weak-dependence versions hain lekin unhe extra conditions chahiye.
The variance of grows like , while its standard deviation grows like
True. toh — yahi growth hai isliye hum limit stabilize karne ke liye se divide karte hain.
A single large sample's histogram becoming bell-shaped is evidence of the CLT
False. Woh histogram ki original distribution estimate karta hai. CLT bahut saare averages ke histogram ke baare mein hai, jahan har ek apne fresh sample se compute hota hai.
The limit in the CLT depends on the third and fourth moments of
False. Limiting shape sirf pehle do moments use karti hai; higher moments (skewness ke zariye) sirf convergence ki speed ko affect karte hain, jaisa ki neeche Berry–Esseen mein quantify kiya gaya hai.
Spot the error
" is skewed, so can't be treated as normal."
Skew individual mein rehta hai; unke 50 ko average karne se zyaadatar skew cancel ho jaata hai, aur ek bell se achhi tarah approximate hota hai. Skewness convergence slow karti hai lekin finite variance ke liye use forbid nahi karti.
"For with , I standardize the cutoff directly."
Tum continuity correction bhool gaye. Ek discrete count ek continuous curve se cover ho rahi hai, isliye use karo (bar ka right edge) uski width capture karne ke liye; ise ignore karne se probability bias hoti hai.
"The CLT says , and since , the limit is a spike at ."
Tumne do alag limits mix kar di. Ek distribution ke roop mein sach mein par collapse hoti hai (yeh LLN hai); CLT pehle se rescale karta hai taaki spread par fixed rahe, jisse non-degenerate milti hai.
"To use the CLT I only need a large , so always works."
"" ka rule of thumb mild skew assume karta hai. Heavily skewed ya heavy-tailed distributions ko approximation achhi hone se pehle saikdon ya hazaron terms chahiye ho sakte hain.
"Because , the probability equals exactly for large ."
Convergence in distribution ka matlab hai — yeh ke paas jaata hai lekin kisi bhi finite ke liye kabhi equal nahi hota. Error choti hai, zero nahi.
"CFs multiply for sums, so ."
Independence characteristic functions ko multiply karati hai, jisse ek power milti hai, ke saath product nahi. ek exponent hai, coefficient nahi.
"In the Taylor step we drop the term because it's small."
Hum ise isliye drop karte hain kyunki humne ko standardize kiya hai, jisse exactly ho jaata hai. Yeh construction se vanish hota hai, negligible hone ki wajah se nahi.
Why questions
Why do we divide by specifically, not or ?
se divide karne par deviation par over-squash ho jaata hai (LLN regime); se divide karne par woh infinity tak blow up karta hai. Sirf , sum ka actual standard deviation, spread ko fixed rakhta hai ek stable limit ke liye.
Why do we use characteristic functions instead of working with densities directly?
Independent sums ke liye, densities messy convolution se combine hoti hain, lekin characteristic functions simply multiply karte hain. CF ek unique fingerprint bhi hai, aur pointwise CF convergence, distributional convergence imply karti hai Lévy's continuity theorem ke zariye.
Why does the CLT proof only need the first two moments?
ka Taylor expansion ke paas hai (yahan expansion ka dummy argument hai); constant term aur term (mean , variance se fixed) -th power limit mein ke baad survive karte hain, jabki sab kuch higher mein sweep ho jaata hai.
Why does the limit become ?
Yeh classic exponential limit hai jahan hai. Isliye bell curve, jiska CF hai, emerge hoti hai chahe inputs kuch bhi rahi hon.
Why does a heavy-tailed distribution converge more slowly (or not at all)?
Rare extreme values sum ko dominate karti hain aur average out hone se mana karti hain. Agar tail itni heavy hai ki , toh koi stabilizing scale nahi hai aur CLT genuinely fail ho jaati hai, jaise Cauchy Distribution ke saath.
Why can we approximate a binomial by a normal at all?
Ek variable i.i.d. Bernoulli trials ka sum hai — exactly woh setup jo CLT ko chahiye — toh uski distribution bell ke paas jaati hai (de Moivre–Laplace theorem).
Why do confidence intervals and z-tests rely on the CLT?
Ye assume karte hain ki standardized sample mean approximately hai, jo precisely wahi hai jo CLT deliver karti hai chahe underlying data non-normal ho.
Why does the normal appear so universally in measurement noise?
Measurement error typically bahut saare tiny independent effects ka sum hota hai; CLT kehti hai aise sums approximately Gaussian hote hain chahe har effect ki individual distribution kuch bhi ho.
How fast does approach normality — is there a bound?
Haan: Berry–Esseen theorem kehta hai , jahan teesra absolute moment hai aur . Error ki tarah shrink hoti hai aur skewness ke saath badhti hai — yeh quantitative reason hai ki skewed data ko bada kyun chahiye.
Edge cases
What happens to the CLT if ?
Tab har probability one ke saath ke barabar hoti hai; koi randomness nahi hai average karne ke liye, undefined hai (division by zero), aur theorem ki hypothesis violate hoti hai.
What if the have finite mean but infinite variance?
Classical CLT apply nahi hoti. Properly scaled sum normal ki jagah ek non-Gaussian stable law ki taraf converge ho sakta hai, aur scaling generally galat hoti hai.
Does the CLT hold if the are independent but not identically distributed?
Haan, ek extra uniformity condition ke under — Lindeberg–Feller Condition — jo ensure karti hai ki koi single term sum ko dominate nahi kare. Iske bina, ek large-variance term normality rok sakti hai.
What is the limiting distribution of the average of Cauchy variables as ?
Yeh exactly Cauchy rehti hai same scale ke saath — yeh concentrate nahi hoti aur kabhi normal nahi banti, yeh Law of Large Numbers aur CLT dono ki ek dramatic failure hai.
For very small (say ) of non-normal data, is approximately normal?
Generally nahi. Itne kam terms ke saath original distribution ki shape abhi bhi dominate karti hai; bell sirf badhne ke saath emerge hoti hai, symmetric light-tailed inputs ke liye zyada jaldi aur skewed ones ke liye zyada slowly.
If the data are already normal, how large must be for the approximation to be good?
Koi bhi — independent normals ka sum ya mean exactly normal hota hai, isliye is special case mein koi minimum sample size ki zaroorat nahi.
Why does a discrete (lattice) variable need a continuity correction but a continuous one does not?
Ek lattice distribution apna saara mass evenly spaced points par rakhti hai (jaise integers), toh uski CDF ek staircase hai. Is staircase par ek smooth normal curve fit karne ka matlab hai ki har jump ko midpoint par split kiya jaaye, yaani cutoff ko shift karo. Ek non-lattice continuous variable ki already smooth CDF hoti hai, toh aisi koi correction ki zaroorat nahi.