4.5.39 · D3 · Maths › Linear Algebra (Full) › Quadratic forms — positive definite, negative definite, inde
Intuition Yeh page kya karta hai (WHY)
Parent note ne tumhe tests bataye the. Yeh page un tests ko har tarah ki matrix ke saath run karta hai — har sign pattern, borderline zero cases, ek degenerate all-zeros machine, ek limiting "ek dial bowl ko saddle mein badal deta hai" family, ek real-world word problem, aur ek exam trap.
Agar koi test alag-alag input pe alag behave kar sakta hai, toh neeche ek example hai jo exactly wahi input feed karta hai. Yeh page khatam karne ke baad tumhare dimag mein koi aisa case nahi hona chahiye jo tumne dekha na ho.
Hum poori note mein do tools use karte hain — eigenvalue test (via Spectral Theorem for Symmetric Matrices ) aur Sylvester's determinant test. Hum Hessian Matrix / Second Derivative Test payoff ke saath close karte hain.
Har 2 × 2 symmetric quadratic form neeche diye ek hi row mein aata hai. Columns tumhe batate hain ki do tests ko kya kehna chahiye , taaki tum khud check kar sako.
#
Cell (kya khaas hai isme)
Eigenvalue signs
Sylvester D 1 , D 2
Type
A
Dono dials upar
+ , +
+ , +
PD
B
Dono dials neeche
− , −
− , +
ND
C
Ek upar, ek neeche
+ , −
any, −
Indefinite
D
Ek dial flat (up branch)
+ , 0
+ , 0
PSD (PD nahi)
E
Ek dial flat (down branch)
− , 0
− , 0
NSD (ND nahi)
F
Dono dials flat — degenerate zero machine
0 , 0
0 , 0
PSD bhi & NSD bhi (sirf zero output)
G
Limiting family — ek parameter PD → PSD → indefinite tip karta hai
0 cross karta hai
D 2 crosses 0
transitions
H
Trap: "D 1 > 0 toh PD hai" (Sylvester misread)
—
+ , −
Indefinite (PD nahi)
I
Word problem — real Hessian, ek cost minimize karo
+ , +
+ , +
PD → minimum
J
Exam twist — 3 × 3 , mixed
mixed
—
Indefinite
Neeche ke examples A–J sab ko cover karte hain.
Worked example Cell A: dono dials upar
Q ( x , y ) = 5 x 2 + 4 x y + 2 y 2 ko classify karo.
Forecast: Saare coefficients positive hain aur cross term chhota hai. Guess: PD (ek bowl) . Aage padhne se pehle apna guess likh lo.
A banao. Diagonals square coefficients 5 aur 2 hain; off-diagonal cross coefficient ka aadha hai, 4/2 = 2 .
A = ( 5 2 2 2 ) .
Yeh step kyun? Tests symmetric matrix pe kaam karte hain, raw formula pe nahi.
Sylvester. D 1 = 5 > 0 , aur D 2 = det A = 5 ⋅ 2 − 2 ⋅ 2 = 6 > 0 .
Yeh step kyun? PD ⟺ har leading minor positive ho — sabse fast haath se check.
Dono positive ⇒ PD.
Verify (eigenvalues, aur sum of squares): λ solve karo ( 5 − λ ) ( 2 − λ ) − 4 = 0 ⇒ λ 2 − 7 λ + 6 = 0 ⇒ λ = 1 , 6 — dono > 0 ✓. Square bhi complete karo: 5 x 2 + 4 x y + 2 y 2 = 5 ( x + 5 2 y ) 2 + 5 6 y 2 > 0 jab tak x = y = 0 na ho. Ek genuine sum of positive squares. ✓
Worked example Cell B: dono dials neeche
Q ( x , y ) = − 2 x 2 + 2 x y − 3 y 2 ko classify karo.
Forecast: Dono square coefficients negative hain. Guess: ND (ek dome) — lekin Sylvester ka pattern dekho, sirf "sab negative" nahi.
A banao: diagonals − 2 , − 3 ; off-diagonal 2/2 = 1 .
A = ( − 2 1 1 − 3 ) .
Sylvester for ND — signs − , + alternate karni chahiye. D 1 = − 2 < 0 ✓ (< 0 chahiye); D 2 = ( − 2 ) ( − 3 ) − 1 = 5 > 0 ✓ (> 0 chahiye).
Yeh step kyun? ND matlab − A PD hai; − A ka k × k minor ( − 1 ) k D k hota hai, toh hume D 1 < 0 , D 2 > 0 chahiye.
Alternating pattern hold karta hai ⇒ ND.
Verify: eigenvalues solve karo ( − 2 − λ ) ( − 3 − λ ) − 1 = 0 ⇒ λ 2 + 5 λ + 5 = 0 ⇒ λ = 2 − 5 ± 5 ≈ − 1.38 , − 3.62 — dono < 0 ✓.
Worked example Cell C: ek dial upar, ek neeche
Q ( x , y ) = x 2 + 4 x y + y 2 ko classify karo.
Forecast: Chhote squares, ek bada cross term. Cross term squares ko overpower kar sakta hai. Guess: indefinite (ek saddle) .
A banao: diagonals 1 , 1 ; off-diagonal 4/2 = 2 .
A = ( 1 2 2 1 ) .
Eigenvalues. ( 1 − λ ) 2 − 4 = 0 ⇒ 1 − λ = ± 2 ⇒ λ = 3 , − 1 . Mixed signs ⇒ indefinite .
Yeh step kyun? Mixed-sign eigenvalues indefinite ki definition hai — ek direction upar curve karti hai, ek neeche.
Actual vectors se confirm karo. λ = 3 ke eigenvector (direction ( 1 , 1 ) ) ke along: Q ( 1 , 1 ) = 1 + 4 + 1 = 6 > 0 . ( 1 , − 1 ) ke along: Q ( 1 , − 1 ) = 1 − 4 + 1 = − 2 < 0 . Dono signs appear hoti hain.
Verify (Sylvester consistency): D 1 = 1 > 0 lekin D 2 = 1 − 4 = − 3 < 0 . Ek negative D 2 already PD aur ND dono ko forbid karta hai, forcing indefinite ✓.
Saddle dekho: pale-yellow ridge (upar jaata hua) λ = 3 eigendirection hai, chalk-blue valley (neeche jaata hua) λ = − 1 direction hai. Center pe khade ho, ek taraf upar jaate ho aur doosri taraf neeche — yahi "indefinite" dikhta hai.
Worked example Cell D: ek dial flat, up branch
Q ( x , y ) = x 2 − 2 x y + y 2 ko classify karo.
Forecast: Yeh ( x − y ) 2 hai. Ek perfect square kabhi negative nahi hota, lekin x = y pe zero hota hai. Guess: PSD, PD nahi .
A banao: diagonals 1 , 1 ; off-diagonal − 2/2 = − 1 .
A = ( 1 − 1 − 1 1 ) .
Sylvester boundary pe ruk jaata hai. D 1 = 1 > 0 , D 2 = 1 − 1 = 0 . Ek zero minor matlab "strictly PD nahi" — hum borderline pe hain.
Yeh step kyun? Sylvester ka strict version PD certify kar sakta hai lekin jab bhi D k = 0 aaye, eigenvalues pe fall back karna padta hai.
Eigenvalues. ( 1 − λ ) 2 − 1 = 0 ⇒ λ = 0 , 2 . Ek zero, ek positive ⇒ PSD .
Zero ka witness. Q ( 1 , 1 ) = 1 − 2 + 1 = 0 jab ( 1 , 1 ) = 0 . Toh yeh zero ko touch karta hai — PSD, PD nahi.
Verify: Q = ( x − y ) 2 ≥ 0 hamesha, aur = 0 exactly line x = y pe ✓.
Worked example Cell E: ek dial flat, down branch
Q ( x , y ) = − x 2 + 2 x y − y 2 ko classify karo.
Forecast: Yeh − ( x − y ) 2 hai. Kabhi positive nahi, x = y pe zero hit karta hai. Guess: NSD, ND nahi — Example 4 ka mirror image.
A banao: diagonals − 1 , − 1 ; off-diagonal 2/2 = 1 .
A = ( − 1 1 1 − 1 ) .
Eigenvalues. ( − 1 − λ ) 2 − 1 = 0 ⇒ λ = 0 , − 2 . Ek zero, ek negative ⇒ NSD .
Yeh step kyun? ≤ 0 with equality possible exactly NSD hai.
Zero ka witness. Q ( 1 , 1 ) = − 1 + 2 − 1 = 0 .
Verify: Q = − ( x − y ) 2 ≤ 0 , x = y pe zero ✓. Sylvester: D 1 = − 1 < 0 lekin D 2 = 0 (> 0 nahi), toh strict ND fail hota hai — boundary ke saath consistent ✓.
Worked example Cell F: dono dials flat
"Kuch nahi karne wali machine" classify karo: Q ( x , y ) = 0 ⋅ x 2 + 0 ⋅ x y + 0 ⋅ y 2 .
Forecast: Har input 0 deta hai. Kabhi positive nahi jaata aur kabhi negative nahi. Guess: yeh ek saath PSD aur NSD hai (ek hi overlap case), aur indefinite nahi hai.
A banao: zero matrix A = ( 0 0 0 0 ) .
Eigenvalues. Dono λ = 0 . Saare eigenvalues ≥ 0 (toh PSD) aur saare ≤ 0 (toh NSD).
Yeh step kyun? Semidefinite definitions mein equality include hai, aur 0 dono ≥ 0 aur ≤ 0 satisfy karta hai.
Indefinite kyun nahi? Indefinite ko ek strictly positive aur ek strictly negative output dono chahiye. Yahan output kabhi nonzero nahi, toh indefinite ho hi nahi sakta.
Verify: Q ( x ) = 0 saare x ke liye; D 1 = D 2 = 0 ✓. Yeh unique degenerate cell hai — flat plane.
Worked example Cell G: dekho definiteness continuously kaise change hoti hai
Ek parameterized machine: Q t ( x , y ) = x 2 + 2 t x y + y 2 ek real dial t ke liye. Woh values of t dhundho jahan type change hoti hai.
Forecast: t = 0 pe yeh x 2 + y 2 hai (PD). Bade t pe cross term dominate karta hai (indefinite, jaise Example 3). Guess: t = 0 ke paas PD, aur kahin tip karta hai.
A banao: A = ( 1 t t 1 ) .
D 2 track karo. D 1 = 1 > 0 (fixed), D 2 = 1 − t 2 . Yahi switch hai.
Yeh step kyun? D 1 kabhi sign nahi badalta, toh poori kahani D 2 = 1 − t 2 ke sign mein hai.
Teen regimes padho:
∣ t ∣ < 1 : D 2 > 0 with D 1 > 0 ⇒ PD .
∣ t ∣ = 1 : D 2 = 0 ⇒ borderline PSD (yeh Example 4 ki matrix hai jab t = − 1 , aur ( x + y ) 2 jab t = 1 ).
∣ t ∣ > 1 : D 2 < 0 ⇒ indefinite .
Eigenvalue confirmation. λ = 1 ± t . Dono positive ⟺ − 1 < t < 1 ; ek t = ± 1 pe zero hit karta hai; ∣ t ∣ > 1 pe opposite signs. Same story.
Verify: t = 2 1 pe, λ = 1.5 , 0.5 (PD) ✓; t = 1 pe, λ = 2 , 0 (PSD) ✓; t = 2 pe, λ = 3 , − 1 (indefinite) ✓.
Figure do eigenvalues 1 + t (pale yellow) aur 1 − t (chalk blue) ko dial t ke against plot karta hai. PD woh band hai jahan dono curves axis ke upar hain ; t = ± 1 pe ek curve zero ko touch karti hai (PSD); uske baahir, ek curve neeche cross karti hai → indefinite. Definiteness literally yeh hai: "kya dono curves line ke upar hain?"
D 1 > 0 , toh PD hona chahiye" — isse rokho
Q ( x , y ) = x 2 + 6 x y + y 2 ko classify karo.
Forecast: Ek tempting-but-wrong reflex: "D 1 = 1 > 0 , positive-looking squares, PD bol do." Decide karne se pehle khud ko D 2 compute karne par majboor karo.
A banao: diagonals 1 , 1 ; off-diagonal 6/2 = 3 .
A = ( 1 3 3 1 ) .
DONO minors compute karo. D 1 = 1 > 0 , lekin D 2 = 1 − 9 = − 8 < 0 .
Yeh step kyun? PD ko har D k > 0 chahiye. Ek positive minor apne aap kuch prove nahi karta.
Negative D 2 ⇒ indefinite (yeh PD nahi hai, aur ND alternating pattern bhi nahi hai).
Verify: eigenvalues λ = 1 ± 3 = 4 , − 2 — mixed signs, indefinite ✓. Witness: Q ( 1 , 1 ) = 8 > 0 , Q ( 1 , − 1 ) = 1 − 6 + 1 = − 4 < 0 ✓.
Common mistake Ek line mein trap
Sirf D 1 (ya sirf diagonal) check karna Sylvester nahi hai . PD claim karne ke liye poori chain D 1 > 0 , D 2 > 0 , … verify karni padti hai.
Worked example Cell I: kya yeh cost surface genuinely minimum hai?
Ek factory ki daily cost (thousands mein) do throughput dials x , y ke function ke roop mein hai:
f ( x , y ) = 3 x 2 − 2 x y + 3 y 2 − 8 x − 4 y + 20.
Tumne ∇ f = 0 solve kiya aur ek critical point mila. Kya yeh minimum hai, maximum hai, ya saddle?
Forecast: Purely quadratic part 3 x 2 − 2 x y + 3 y 2 hai, bade positive squares, chhota cross term. Guess: ek real minimum (bowl-shaped cost).
Hessian yahan constant hai. ∂ x 2 ∂ 2 f = 6 , ∂ y 2 ∂ 2 f = 6 , ∂ x ∂ y ∂ 2 f = − 2 , toh
H = ( 6 − 2 − 2 6 ) .
Yeh step kyun? Second Derivative Test ek critical point ko Hessian quadratic form ki definiteness se classify karta hai.
H ko Sylvester se test karo. D 1 = 6 > 0 , D 2 = 36 − 4 = 32 > 0 ⇒ PD .
PD Hessian ⇒ local minimum (bowl). Toh haan — cost wahan sach mein bottom out karti hai.
Verify (locate karo, units check): ∇ f = 0 solve karo: 6 x − 2 y = 8 aur − 2 x + 6 y = 4 ⇒ x = 4 7 , y = 4 5 . H ke eigenvalues: λ = 6 ± 2 = 8 , 4 , dono > 0 ✓ PD. Cost ki units thousands hain aur H ki entries (thousands)/(dial2 ) hain, consistent — har direction mein positive curvature matlab har deviation cost badhata hai ✓.
Worked example Cell J: teen variables, panic mat karo
Q ( x , y , z ) = x 2 + y 2 − z 2 + 2 x y ko classify karo.
Forecast: − z 2 ek downward direction ki smell deta hai jabki x , y upar lagte hain. Guess: indefinite — lekin check karo ki 2 x y x , y block ko toh nahi bigaad raha.
3 × 3 A banao: diagonals 1 , 1 , − 1 ; ek hi cross term 2 x y hai toh A 12 = A 21 = 1 , baaki saare off-diagonals 0 .
A = 1 1 0 1 1 0 0 0 − 1 .
Block structure ⇒ eigenvalues easy hain. Top-left 2 × 2 block ( 1 1 1 1 ) ke eigenvalues 0 aur 2 hain; isolated − 1 se λ = − 1 milta hai. Toh spectrum { 2 , 0 , − 1 } hai.
Yeh step kyun? Block-diagonal matrix ke eigenvalues sirf blocks ke eigenvalues ka union hote hain — koi messy cubic nahi chahiye.
Mixed signs (+ 2 aur − 1 ) ⇒ indefinite. Extra zero eigenvalue ka matlab yeh bhi hai ki yeh kisi bhi case mein strictly definite nahi hai.
Verify: witnesses — Q ( 1 , 1 , 0 ) = 1 + 1 + 2 = 4 > 0 ; Q ( 0 , 0 , 1 ) = − 1 < 0 . Dono signs, plus ek null direction ( 1 , − 1 , 0 ) jisme Q = 1 + 1 − 2 = 0 . Indefinite confirm ✓.
Recall Poore matrix mein quick self-test
Kis cell mein D 1 > 0 , D 2 = 0 aur eigenvalues 0 , + hain? ::: Cell D — PSD, PD nahi.
Kaun sa ek cell PSD aur NSD dono ek saath hai? ::: Cell F — zero machine (sirf zero output).
Family x 2 + 2 t x y + y 2 mein, kis t pe PD khatam hota hai? ::: ∣ t ∣ = 1 (wahan D 2 = 1 − t 2 = 0 ).
Akela D 1 > 0 PD ke liye kyun ENOUGH nahi hai? ::: PD ko poori chain D 1 > 0 , D 2 > 0 , … chahiye; ek minor positive ho sakta hai jabki D 2 < 0 (indefinite) — Cell H trap.
Critical point pe PD Hessian kya signal karta hai? ::: Ek local minimum (bowl).
Mnemonic Poora matrix ek line mein yaad karo
"Dono upar = bowl, dono neeche = dome, ek-ek = saddle, ek flat = zero ko kiss karta hai, dono flat = so jaata hai."
Bowl = PD, dome = ND, saddle = indefinite, kiss = semidefinite, so jaana = degenerate zero form.