4.9.1 · Maths › Probability Theory & Statistics
Intuition Bada picture (YEH kyun exist karta hai)
Pehle hum probabilities compute kar sakein, humein agree karna hoga ki hum actually measure kya kar rahe hain .
Ek probability space woh rigorous "stage" hai jis par poori probability perform hoti hai.
Yeh teen sawaalon ke jawaab deta hai:
Kya ho sakta hai? → sample space Ω .
Outcomes ke kaun se collections ko hum probability assign karne ki permission rakhte hain? → sigma-algebra F .
Har allowed collection ko kitni probability milti hai? → measure P .
F ki zaroorat kyun hai? Kyunki uncountable sets (jaise [ 0 , 1 ] ) par aap har subset ko consistently probability assign nahi kar sakte — pathological sets rules tod deti hain. Isliye hum ek well-behaved family F tak restrict karte hain.
Definition Probability space
Ek probability space ek triple ( Ω , F , P ) hota hai jahan:
Ω = sample space , sabhi possible outcomes ω ka set.
F = ek sigma-algebra (Ω ke subsets ka ek collection jise events kehte hain).
P = ek probability measure , ek function P : F → [ 0 , 1 ] jo Kolmogorov ke axioms maanta hai.
Yeh teen kyun? Yeh minimum closure rules hain taaki events ke kisi bhi logical combination ("not A", "A or B", "A and B", "infinitely mein se kam se kam ek") ek aisa event rahe jise hum measure kar sakein. 1–3 se aapko baaki sab milta hai:
∅ = Ω c ∈ F (1 + 2 se).
Countable intersections : ⋂ i A i = ( ⋃ i A i c ) c ∈ F (De Morgan, 2 + 3 use karke).
F
F ko un yes/no sawaalon ki list ke roop mein socho jo tum poochh sakte ho. Agar tum poochh sakte ho "kya A hua?", toh tum yeh bhi poochh sakne chahiye "kya A nahi hua?" aur "kya A ya B hua?". Ek sigma-algebra bas yeh rule hai ki yeh sawaalon ki list logically complete hai.
Har axiom kyun?
A1 — probability ek "mass"/"size" hai; sizes kabhi negative nahi hoti.
A2 — Ω mein kuch na kuch zaroor hoga, isliye total mass 1 par normalize hoti hai.
A3 — agar ek event ko disjoint pieces mein tod do, toh probabilities add hoti hain. "Countable" (sirf finite nahi) version hi hai jo limits, integrals, aur continuous distributions ko kaam karne deta hai.
Neeche kuch bhi extra rule nahi hai — sab theorems hain jo A1–A3 se forced hain.
P ( ∅ ) = 0 derive karo
Disjoint sequence lo A 1 = Ω , A 2 = A 3 = ⋯ = ∅ . Tab ⋃ A i = Ω .
A3 se: P ( Ω ) = P ( Ω ) + ∑ i ≥ 2 P ( ∅ ) .
Yeh step kyun? A3 mujhe union ko P ( ∅ ) ke identical terms ki sum mein expand karne deta hai.
Toh ∑ i ≥ 2 P ( ∅ ) = 0 . Kyunki har term ≥ 0 hai (A1), har ek 0 honi chahiye. ■
A , B ke liye finite additivity P ( A ∪ B ) = P ( A ) + P ( B ) derive karo
Khali se pad karo: A 1 = A , A 2 = B , A 3 = A 4 = ⋯ = ∅ . Yeh disjoint hain.
A3 aur P ( ∅ ) = 0 se: P ( A ∪ B ) = P ( A ) + P ( B ) + 0 + 0 + … . ■
Yeh step kyun? A3 infinite unions ke liye stated hai; ∅ se padding finite case recover karti hai.
Complement rule P ( A c ) = 1 − P ( A ) derive karo
A aur A c disjoint hain aur A ∪ A c = Ω .
Finite additivity: P ( Ω ) = P ( A ) + P ( A c ) .
A2 se, P ( Ω ) = 1 , isliye P ( A c ) = 1 − P ( A ) . ■
Consequence: P ( A ) = 1 − P ( A c ) ≤ 1 , toh A1 ke saath combine karke, 0 ≤ P ( A ) ≤ 1 — range [ 0 , 1 ] derived hai, assume nahi ki gayi.
Monotonicity A ⊆ B ⇒ P ( A ) ≤ P ( B ) derive karo
Likho B = A ∪ ( B ∖ A ) , ek disjoint union (kyunki B ∖ A = B ∩ A c ).
Finite additivity: P ( B ) = P ( A ) + P ( B ∖ A ) .
Yeh step kyun? B ko A ke andar wale hisse aur bahar wale hisse mein split karna additivity apply karne deta hai.
A1 se, P ( B ∖ A ) ≥ 0 , isliye P ( B ) ≥ P ( A ) . ■
Inclusion–exclusion P ( A ∪ B ) = P ( A ) + P ( B ) − P ( A ∩ B ) derive karo
Disjoint pieces mein split karo:
A ∪ B = ( A ∖ B ) ⊔ ( A ∩ B ) ⊔ ( B ∖ A ) .
Additivity: P ( A ∪ B ) = P ( A ∖ B ) + P ( A ∩ B ) + P ( B ∖ A ) .
Saath hi P ( A ) = P ( A ∖ B ) + P ( A ∩ B ) aur P ( B ) = P ( B ∖ A ) + P ( A ∩ B ) .
Yeh step kyun? A aur B dono boundary A ∩ B par split hote hain.
Last do add karo: P ( A ) + P ( B ) = P ( A ∖ B ) + P ( B ∖ A ) + 2 P ( A ∩ B ) .
Pehle equation se match karne ke liye ek P ( A ∩ B ) subtract karo:
P ( A ∪ B ) = P ( A ) + P ( B ) − P ( A ∩ B ) . ■
Worked example Finite (die) space
Ek fair die roll karo. Ω = { 1 , 2 , 3 , 4 , 5 , 6 } , F = 2 Ω (saare 64 subsets), P ( A ) = ∣ A ∣/6 .
Maano A = { even } = { 2 , 4 , 6 } , B = { >3 } = { 4 , 5 , 6 } .
P ( A ) = 3/6 , P ( B ) = 3/6 , A ∩ B = { 4 , 6 } toh P ( A ∩ B ) = 2/6 .
P ( A ∪ B ) = 6 3 + 6 3 − 6 2 = 6 4 = 3 2 . Check: A ∪ B = { 2 , 4 , 5 , 6 } , 4 outcomes → 4/6 . ✓
Yahaan F = 2 Ω kyun? Ω finite hai, isliye har subset measurable hai — koi pathology nahi.
Worked example Continuous (uniform) space
Ω = [ 0 , 1 ] mein uniformly ek point choose karo. Yahaan F = Borel sets, P ([ a , b ]) = b − a .
P ([ 0 , 0.3 ]) = 0.3 , P ({ 0.5 }) = 0 (single point ki length 0 hai).
Single point ki probability 0 kyun hai: { 0.5 } = ⋂ n [ 0.5 , 0.5 + n 1 ] , aur P ([ 0.5 , 0.5 + n 1 ]) = n 1 → 0 (continuity from above). Phir bhi 0.5 ho sakta hai — probability 0 ≠ impossible .
Ω ka har subset ek event hai."
Yeh sahi kyun lagta hai: Finite die par, yeh hai — F = 2 Ω theek kaam karta hai.
Fix: Uncountable Ω jaise [ 0 , 1 ] par, non-measurable (Vitali) sets exist karti hain jo countable additivity tod deti hain. Isliye hum sigma-algebra (Borel sets) tak restrict karte hain. F , 2 Ω se chhota ho sakta hai.
Common mistake "Additivity kisi bhi union ke liye kaam karti hai:
P ( A ∪ B ) = P ( A ) + P ( B ) hamesha."
Yeh sahi kyun lagta hai: Yeh sach hai jab A , B disjoint hain, aur beginners zyaadatar wahi case dekhte hain.
Fix: Agar woh overlap karte hain toh tum A ∩ B ko double-count karte ho. Inclusion–exclusion use karo: P ( A ∩ B ) subtract karo.
P ( A ) = 0 matlab A impossible hai."
Yeh sahi kyun lagta hai: Impossible events (∅ ) ki probability 0 hoti hi hai.
Fix: Converse fail hota hai. Continuous spaces mein individual points ki probability 0 hoti hai par woh phir bhi ho sakte hain. "Probability 0" = "almost never", "never" nahi.
Common mistake "Finite additivity kaafi hai; countable toh sirf fancy hai."
Yeh sahi kyun lagta hai: Saare real coin/die experiments finite hain.
Fix: Countable additivity (A3) strictly stronger hai aur yahi guarantee karta hai P ki continuity, limits handle karne deta hai, aur random variables, expectations, aur law of large numbers ki neenv hai.
Recall Quick self-test (answers hide karo)
Sigma-algebra ke teen closure rules kya hain? → Ω contain karta hai; complement ke under closed; countable union ke under closed.
P ka range [ 0 , 1 ] kyun? → A1 se ≥ 0 ; complement rule + A2 se ≤ 1 .
Kolmogorov A3 state karo. → disjoint events ke liye countable additivity.
P ( A c ) derive karo. → P ( A ) + P ( A c ) = P ( Ω ) = 1 se 1 − P ( A ) .
Recall Feynman: ek 12-saal ke bachche ko samjhao
Ek bada bag socho (woh Ω hai) jisme har possible cheez jo ho sakti hai rakhhi hai. Tumhein sirf kuch fair sawaal poochhne ki permission hai bag ke andar kya hai — aur rule yeh hai, agar tum ek sawaal poochh sakte ho, toh tum uska ulta bhi poochh sakne chahiye aur sawaal combine kar sakne chahiye; woh sawaalon ki list F hai. Phir P ek jaise hai exactly 1 liter paint saare sawaalon par baantna: kisi sawaal ko negative paint nahi milti (A1), pura bag saara 1 liter use karta hai (A2), aur agar do sawaal kabhi overlap nahi karte, unka paint bas add ho jaata hai (A3). Probability mein baaki sab bas is paint ko bina girae idhar-udhar daalte rehna hai.
Mnemonic Trio yaad rakhho
"O-F-P: Outcomes, Filter, Paint."
Ω = saare O utcomes; F = poochhhne-layak sawaalon ka F ilter; P = P aint (total = 1).
Aur axioms: "NNA" = N on-negative, N ormalized, A dditive.
Probability space mein kaun se teen objects hote hain? ( Ω , F , P ) : sample space, events ki sigma-algebra, probability measure.
Sample space Ω kya hai? Experiment ke sabhi possible outcomes ka set.
Sigma-algebra ke teen axioms list karo. Ω contain karta hai; complement ke under closed; countable unions ke under closed.
F complement AUR union ke under closed kyun hona chahiye?Taaki events ka koi bhi logical combination (not, or, and) ek measurable event rahe.
Kolmogorov ke teen axioms state karo. A1 P ( A ) ≥ 0 ; A2 P ( Ω ) = 1 ; A3 disjoint events ke liye countable additivity.
P ( ∅ ) = 0 derive karo.Disjoint Ω , ∅ , ∅ , … use karo; A3 se P ( Ω ) = P ( Ω ) + ∑ P ( ∅ ) milta hai, toh har P ( ∅ ) = 0 .
Complement rule derive karo. A ∪ A c = Ω disjoint ⇒ P ( A ) + P ( A c ) = 1 ⇒ P ( A c ) = 1 − P ( A ) .
0 ≤ P ( A ) ≤ 1 axiom kyun nahi hai?≥ 0 A1 hai; ≤ 1 complement rule + A2 se follow karta hai. Range derived hai.
Do events ke liye inclusion–exclusion state aur derive karo. P ( A ∪ B ) = P ( A ) + P ( B ) − P ( A ∩ B ) , disjoint pieces A ∖ B , A ∩ B , B ∖ A mein split karke.
[ 0 , 1 ] par F = 2 Ω kyun nahi ho sakta?Non-measurable (Vitali) sets exist karti hain jo countable additivity violate karti hain, isliye hum Borel sets use karte hain.
Kya P ( A ) = 0 matlab A impossible hai? Nahi. Continuous spaces mein single points ki probability 0 hoti hai par woh phir bhi ho sakte hain ("almost never").
Monotonicity: agar A ⊆ B toh probabilities ke baare mein kya? P ( A ) ≤ P ( B ) , kyunki P ( B ) = P ( A ) + P ( B ∖ A ) aur P ( B ∖ A ) ≥ 0 .
Countable (sirf finite nahi) additivity kyun? Yeh P ki continuity deta hai aur limits, integrals, aur continuous distributions handle karne deta hai.
Closed under countable union
Countable intersection derived