1.3.21 · D4 · HinglishProbability & Statistics

ExercisesConfidence intervals

3,000 words14 min read↑ Read in English

1.3.21 · D4 · AI-ML › Probability & Statistics › Confidence intervals

Shuru karne se pehle, ek picture jo neeche ke har problem mein kaam aati hai. Figure s01 ek confidence interval ki anatomy dikhata hai: coral line center mein point estimate mark karti hai; lavender bar pura interval hai; aur do mint arrows mein se har ek interval ki half-width hai, yaani margin of error (iska symbol theek neeche define kiya gaya hai). Ise yun samjho: "interval hai jisme dono taraf ek symmetric cushion hai." Neeche ke har solution mein exactly yahi picture banti ya padhi jaati hai.

Figure — Confidence intervals

Critical values jo chahiye honge (top row yaad karo):

Confidence
90% 0.10 1.645
95% 0.05 1.960
99% 0.01 2.576

Level 1 — Recognition

Recall Solution L1·Q1

Kya decide karta hai: do sawaal — kya known hai, aur kya bada hai ()? Yahan unknown hai aur , isliye hume ==-distribution== use karni hogi. Iske heavier tails ki jagah use karne ki extra uncertainty ka bhugtan karte hain. Degrees of freedom .

Recall Solution L1·Q2

(a) Point estimate interval ka center hai (Figure s01 mein coral line): (b) Margin of error half-width hai — ek mint arrow ki length, center se kisi bhi end tak ki doori:

Recall Solution L1·Q3

99% confidence ka matlab . Us bacha hua probability ko dono tails mein equally split karte hain, toh har tail mein aata hai. Upar wale 0.5% tail ko cut off karne wala value hai Agar ki jagah use karte to sirf ek side guard hoti aur net doosri taraf se leak ho jaata.


Level 2 — Application

Recall Solution L2·Q1

Step 1 — standard error (sample mean ka spread): Step 2 — margin of error (): Step 3 — interval (, exactly s01 picture):

Recall Solution L2·Q2

Step 0 — check karo ki approximation valid hai. Proportion ke liye normal approximation ko kaafi "successes" aur "failures" chahiye. Common rule of thumb hai aur (ek looser version use karta hai): Dono comfortably bar clear kar lete hain, toh normal approximation safe hai. (Agar koi bhi 5–10 se neeche hota — jaise koi rare event — toh hum exact binomial ya Wilson interval use karte.) Step 1 — point estimate: Step 2 — standard error proportion ke liye (binomial variance ): Step 3 — margin : .

Recall Solution L2·Q3

, toh ; unknown hai aur use karo.


Level 3 — Analysis

Recall Solution L3·Q1

Margin ki definition se shuru karo aur ko step by step isolate karo. Step 1 — jo pata hai woh likho: Step 2 — ko upar lao. denominator mein ke andar chhupa hai, toh pehle dono sides ko se multiply karo aur dono sides ko se divide karo taaki ek taraf akela aa jaye: Step 3 — square root hatao. Unknown abhi bhi ke neeche fansa hai, aur "square root" ka inverse "square" hai, toh dono sides ko square karo (square karna yahan legal hai kyunki har quantity — , , , — positive hai): Step 4 — numbers daalo: Hamesha round up karo (fractional person exist nahi karta aur neeche round karne se target miss ho jaata hai):

Recall Solution L3·Q2

Width hai. Width aadhi karne ke liye chahiye , yaani Sabak: precision mehengi hoti hai — error aadhi karne mein 4× zyada data lagta hai. Figure s02 ise concrete banata hai: yeh interval width ko ke against plot karta hai. Curve ki tarah girta hai, aur do marked dots ( coral mein, mint mein) ek doosre ki exactly aadhi height par hain — sirf aadha neeche aane ke liye tum chart par chaar guna daayein jaate ho.

Figure — Confidence intervals
Recall Solution L3·Q3

Independent estimates ka difference → variances add hote hain: Interval 0 ko include karta hai, toh hum yeh conclude nahi kar sakte ki B sach mein better hai — matched view ke liye dekho Hypothesis Testing aur A/B Testing.


Level 4 — Synthesis

Recall Solution L4·Q1

Mean: . Deviations aur squares: ; sum . Sample variance (Bessel ): , toh . Standard error: . Margin: . Interval — center , dono taraf cushion :

Recall Solution L4·Q2

-interval approximate normality maanta hai (ya bada taaki CLT smooth kare); ke saath, skew aur outlier dono ko violate karte hain, toh interval mis-centred aur mis-sized hoga. Safer choice hai ek percentile bootstrap interval — 8 scores ko replacement ke saath hazaron baar resample karo aur 5th/95th percentiles padho (dekho Bootstrap Methods aur Cross-validation).

Recall Solution L4·Q3

Ek baar compute ho jaane ke baad interval fixed ho jaata hai aur ek fixed (unknown) constant hai — true mean ya toh usme hai ya nahi, probability bacha hi nahi. 90% procedure describe karta hai: agar hum yeh sampling-and-interval recipe baar baar repeat karein, toh lagbhag 90% resulting intervals ko contain karenge.


Level 5 — Mastery

Recall Solution L5·Q1

Planning (expected 0.20 use karo). Proportion SE deta hai Observed CI with , (quick validity check: , , toh normal approximation theek hai): Realised margin () target se thoda zyada hai kyunki observed ka variance planned se zyada hai — ek sabak: jab sure na ho toh most conservative () se plan karo.

Recall Solution L5·Q2

Frequentist net: interval random hai, ek fixed machhli hai; 95% nets jo hum phainkein unhe pakad leti hain, lekin koi ek net ya toh pakadti hai ya nahi. Bayesian pond: ko random treat kiya jaata hai ek probability distribution ke saath; 95% credible interval genuinely us posterior probability ka 95% hold karta hai, toh "95% probability hai ki andar hai" wahan legitimate hai. Coincidence: flat (uninformative) prior aur bade ke saath, posterior likelihood se dominate hota hai aur dono intervals numerically almost identical ho jaate hain.

Recall Solution L5·Q3

Red flags:

  1. bahut tiny hai. Critical value hai (jo se kaafi upar hai), jo akela net ko bahut wide bana deta hai — study badly under-powered hai.
  2. unknown aur data non-normal. -interval approximate normality par depend karta hai (ya bade par via CLT); aur skew ke saath, dono nahi milte, toh interval dono mis-centred aur mis-sized hai.
  3. CI mein 0 hai. Kyunki zero ko straddle karta hai, effect statistically "no effect" se distinguishable nahi hai — tum real effect ka claim nahi kar sakte.
  4. Sirf point estimate "3.0" report karna. Crisp center quote karna chhupa deta hai ki honest interval tak failta hai, jo ek badi range hai; yeh false precision hai (L3-style "wide interval is honest" ka sabak).

Kya karein: zyada data collect karo — L3·Q2 se yaad karo ki width aadhi karne ke liye sample chahiye; non-normality ki wajah se bootstrap percentile interval use karo; interval ko ek formal hypothesis test se back up karo ki effect 0 se alag hai ya nahi; aur hamesha full interval report karo, kabhi sirf point estimate nahi.