Worked examples — Monte Carlo simulation — law of large numbers basis
4.9.25 · D3· Maths › Probability Theory & Statistics › Monte Carlo simulation — law of large numbers basis
Symbols aane se pehle, parent note ke teen characters ki ek reminder:
Scenario matrix
Har Monte Carlo problem inhi case classes mein se ek mein aata hai. Table ek map hai; neeche ke examples har row ko fill karte hain.
| Cell | Case class | Kya cheez ise alag banati hai | Example |
|---|---|---|---|
| A | Bounded integrand on | Textbook case, finite variance | Ex 1 |
| B | Integral on | Uniform ke liye rescale karna zaroori | Ex 2 |
| C | Improper / infinite range | Uniform impossible — sampling density badlo | Ex 3 |
| D | Probability = indicator average (0/1 output) | sirf 0 ya 1 return karta hai (Bernoulli) | Ex 4 |
| E | Degenerate: constant → zero variance | , ek hi sample mein converge | Ex 5 |
| F | Limiting behaviour: error kaise scale karta hai? | Target accuracy ke liye plan karo | Ex 6 |
| G | Heavy tail: variance infinite → LLN toot jaata hai | Woh ek case jo converge NAHI karta | Ex 7 |
| H | Real-world word problem | Story ko expectation mein translate karo | Ex 8 |
| I | Exam twist: variance reduction | Same , chhota | Ex 9 |
Prerequisite links jo aap open rakhna chahein: Bernoulli Distribution, Variance and Covariance, Central Limit Theorem, Chebyshev's Inequality, Numerical Integration, Importance Sampling, Strong Law of Large Numbers. Yeh page Monte Carlo simulation — law of large numbers basis ka child hai.
Ex 1 — Cell A: bounded integrand on
Active symbol: random input hai (uniform).
Forecast: true value guess karo aur guess karo ki kya samples 2 decimals sahi denge. (Padhne se pehle likh lo.)
Step 1 — Integral ko expectation mein badlo. Yeh step kyun? par uniform density constant hai, toh by definition ka average hai. Yahan .
Step 2 — Estimator likho. Kyun? True average ko sample average se replace karo — LLN promise karta hai yeh converge karega.
Step 3 — True value & true variance (taaki pata ho kya expect karein). kyun compute karein? Kyunki hume error size pehle se batata hai, kuch bhi run karne se pehle.
Step 4 — par predicted error. kyun plug in karein? Humne wahi sample size li jo forecast ne poocha tha, taaki hum pehle se decide kar sakein ki kya yeh 2 decimals dega — koi simulation nahi chahiye.
Verify: , aur , toh ek typical run ke roughly (do SEs) ke andar land karta hai — roughly 2 decimals tak sahi. Forecast check out karta hai. Units: dimensionless (pure number).
Ex 2 — Cell B: general interval par integral
Active symbol: random input hai (uniform, lekin ab par).
Forecast: interval ki length 3 hai, 1 nahi. Guess karo: " length" factor average ke andar jaata hai ya bahar?
Step 1 — par uniformly sample karo. Ek point ki density hai (constant, lekin ab nahi ). Yeh step kyun? Lambe interval par, "evenly spread" ka matlab hai har unit of length ko probability milti hai, toh density shrink ho jaati hai.
Step 2 — Expectation se integral recover karo. Kyun? Density integral ko divide karti hai; ise undo karne ke liye average ko se multiply karo. Length factor average ke BAHAR hai.
Step 3 — Estimator. Exactly yeh form kyun? Step 2 ne prove kiya ; hum simply true average ko sample average se replace karte hain (LLN) aur constant ko bahar rakhte hain — yahi estimator hum actually run karenge.
Step 4 — Check ke liye true value. Exact integral yahan kyun compute karein? Is case mein ek elementary antiderivative hai, toh hum true by hand nikaal sakte hain aur ise yardstick ki tarah use kar sakte hain jise Monte Carlo estimate match karna chahiye — validation, method nahi.
Verify: . Sanity check: interval ki width 3 hai aur se tak range karta hai, toh integral aur ke beech hona chahiye. Humara aaram se andar hai. ✔
Ex 3 — Cell C: par improper integral
Active symbol: random input hai (exponential), uniform se ke zariye bana.
Forecast: " par uniformly sample karo" possible nahi — infinite line par koi even spread nahi hoti. Guess karo hum isse kaise bachte hain.

Step 1 — Built-in density pehchano. Function for ek genuine probability density hai: yeh positive hai aur . Yeh Exponential(1) distribution hai. Yeh step kyun? Kyunki hum infinite line par uniform nahi bana sakte, hum instead ek aisi density se sample karte hain jo already wahan rehti hai. Figure mein red curve samples ko 0 ke paas pack karti hai aur infinity ki taraf thin karti hai, exactly jahan kehta hai "mass" hai.
Step 2 — Integrand ko density leftover mein split karo. Kyun? Density ko hum jo bhi multiply karte hain woh function ban jaata hai jise hum average karte hain. Yahan leftover simply hai, aur active input ab hai (uniform nahi).
Step 3 — Exponential samples generate karo. draw karo aur set karo. Yeh standard trick (inverse-CDF) uniform ko Exponential(1) mein badal deti hai. Kyun? Humare paas sirf uniform RNGs hain; unhe density mein reshape karta hai jo chahiye. Yeh Importance Sampling ka seed hai.
Step 4 — Estimator. Yeh form kyun? Step 2 ne ko with likh diya, toh ka sample mean natural estimator hai — koi extra density factor nahi chahiye kyunki absorb ho gaya hai jis tarah hum sample karte hain ussi mein.
Step 5 — True value. Yeh formula kyun? Standard result with .
Verify: . Sanity: aur ke beech oscillate karta hai lekin samples chhote ke paas cluster karte hain jahan , toh 1 se neeche ek positive value expected hai. ✔
Ex 4 — Cell D: indicator average ke roop mein probability
Active symbol: random input pair hai, har coordinate independent .
Forecast: unit square mein ke upar ka region — uska area ek fraction ke roop mein guess karo.

Step 1 — Indicator define karo. Yeh step kyun? Probability 0/1 indicator ki expectation hai: . ka output ek coin flip hai — yeh Bernoulli Distribution hai.
Step 2 — Estimator = "yes" darts ka fraction. Kyun? 0s aur 1s ka average sirf successes ka fraction count karta hai — exactly figure mein red-dot fraction.
Step 3 — True value. Parabola ke upar ka area = total square minus uske neeche ka area: Subtract kyun? Poore square ka area hai; parabola ke neeche ka region area rakhta hai; baaki sab "above" region hai, toh .
Step 4 — Iska variance (Bernoulli). ke saath: Care kyun karein? Indicator outputs ka variance hamesha hota hai, par maximise hota hai. Extreme probabilities (0 ya 1 ke paas) saste estimate hote hain.
Verify: . Sanity: parabola neeche dip karti hai, toh square ka zyada hissa uske upar hai — se upar fraction expected hai. ✔
Ex 5 — Cell E: degenerate, zero-variance case
Active symbol: random input — lekin jaise hum dekhenge, koi fark nahi padta hum kya sample karte hain.
Forecast: is "estimate" ko exactly sahi hone ke liye kitne samples chahiye?
Step 1 — Expectation compute karo. Kyun? Kisi cheez ka average jo hamesha 7 hai woh 7 hai — koi randomness nahi.
Step 2 — Variance compute karo. Yeh kyun matter karta hai? har ke liye, par bhi.
Step 3 — Degenerate limit interpret karo. Ek single sample exactly deta hai. Zyada samples add karne se kuch nahi badalta. Kyun? Zero spread ke saath koi noise nahi hai average karne ke liye — estimator sample one par hi target hit kar chuka hai.
Verify: , . Kisi bhi length ka koi bhi run exactly 7 return karta hai. ✔
Ex 6 — Cell F: limiting behaviour, plan karna
Active symbol: random input , Ex 1 jaisa hi.
Forecast: Ex 1 ne par hit kiya. Half-width ~ shrink karne ke liye guess karo: thode zyada samples, ya BAHUT zyada?

Step 1 — Target likho. half-width (upar define ki gayi) hai. Demand karo Yeh step kyun? Yeh half-width confidence interval ki "" hai; ise se neeche force karna exactly woh accuracy hai jo problem maangti hai, toh hum ke liye solve karte hain jo ise achieve karta hai.
Step 2 — ke liye solve karo. Square kyun? Kyunki error square root ke neeche rehti hai; ise undo karne se sab kuch square ho jaata hai — brutal law ka source.
Step 3 — Numbers plug karo. : Toh samples chahiye. Exactly yeh particular numbers kyun substitute karein? Central Limit Theorem se factor hai, woh variance hai jo hum Ex 1 mein already compute kar chuke, aur squared target hai; inhe plug karne se abstract inequality ek concrete sample budget ban jaati hai jo hum actually afford kar sakte hain.
Verify: figure mein red line half-width dikhati hai. Half-width (at , yaani ) se tak jaana ek reduction hai, zyada samples chahiye: . ✔ Match karta hai. Bees-guna accuracy ~340× kaam ki cost maangti hai.
Ex 7 — Cell G: heavy tail, LLN toot jaata hai
Active symbol: random input hai (heavy-tailed, uniform nahi).
Forecast: density 0 ke baare mein symmetric hai, toh surely mean 0 hai aur sample mean wahan converge karta hai. Guess karo kya woh reasoning safe hai.

Step 1 — Integrability condition check karo. Weak Law ko chahiye. Test karo: Yeh step kyun? Bade ke liye integrand jaisa behave karta hai, aur diverge karta hai (logarithmically). Mean exist nahi karta.
Step 2 — Consequence. Kyunki , Strong Law of Large Numbers apply nahi karta. Sample mean settle nahi karta — remarkably, Cauchy samples ka khud standard Cauchy hai, chahe kitna bhi bada ho. Yeh kyun matter karta hai? Figure mein red trace hamesha ke liye wild jumps leta rehta hai; fat tails se occasional gigantic samples baar baar running average ko hijack karte hain.
Step 3 — Moral. Symmetry ne suggest kiya "mean ", lekin mean undefined hai, toh LLN converge karne ke liye kuch hai hi nahi.
Verify: diverge karta hai — hum tail ke divergent integral confirm karte hain partial integrals compare karke jo bina bound ke grow karte hain. ✔ (VERIFY dekho.)
Ex 8 — Cell H: real-world word problem
Active symbol: har box ka random input teen uniforms ka triplet hai; failures ki count ek derived random variable hai.
Forecast: sirf per-bulb failure ke saath, guess karo kya returns rare () ya common () hain.
Step 1 — Har box model karo. Failures ki sankhya (3 Bernoulli Distribution flips ka sum). Define karo Yeh step kyun? "Return probability" hai — phir se ek probability indicator average ke roop mein likhi gayi.
Step 2 — Monte Carlo recipe. Har box ke liye 3 uniforms simulate karo, count karo kitne hain (failures), record karo kya hain, kai boxes par average karo. Kyun? Har simulated box ka ek draw hai; LLN returned fraction ko true probability par converge karta hai. se neeche ka ek uniform exactly time hota hai, toh yeh faithfully ek bulb fail hone ko mimic karta hai.
Step 3 — Check karne ke liye exact value. Exactly kyun compute karein? Ek chhote discrete model wale word problem ko binomial formula se exactly check kiya ja sakta hai, toh hum simulator ko ground truth ke saath validate karte hain blindly trust karne ki jagah.
Verify: (roughly ) — returns rare hain, "rare" forecast jeeta. Units: ek probability, dimensionless, mein. ✔
Ex 9 — Cell I: exam twist, variance reduction
Active symbol: random input hai; antithetic partner bhi hai lekin same draw se bana.
Forecast: dono same dete hain. Guess karo ki pairing help karta hai, hurt karta hai, ya kuch nahi karta.
Step 1 — True value (check ke liye). Yahan se shuru kyun karein? ka elementary antiderivative hai, toh hum exact pin kar sakte hain aur baad mein confirm kar sakte hain ki dono estimators same target par aim karte hain.
Step 2 — Plain estimator variance. , aur Numerically aur , toh . Kyun? ; variance hai second moment minus mean squared, standard .
Step 3 — Antithetic estimator. Har draw ke liye use karo, phir 's ka average lo. Yeh step kyun? aur negatively correlated hain (jab ek bada hota hai doosra chhota), toh unka average chhoti variance rakhta hai aur same mean maintain karta hai. Yeh Importance Sampling-style variance reduction ka workhorse hai.
Step 4 — Antithetic variance (per pair). Symmetry se dono variances ke barabar hain; covariance negative hai: Toh kyun? Kyunki constant hai — exponents hamesha 1 mein add ho jaate hain! Isliye correlation itna strongly negative hai aur variance almost cancel ho jaati hai.
Verify: plain per-sample variance ; antithetic per-pair variance . Ratio chhoti variance — ek massive win. Same target . ✔