Visual walkthrough — Dot product — formula, cosine formula, Cauchy-Schwarz inequality proof

4.5.2 · D2 · Maths › Linear Algebra (Full) › Dot product — formula, cosine formula, Cauchy-Schwarz inequa

Shuru karne se pehle, teen words jinpar hum agree kar lein, har ek neeche ek picture se juda hai.

---

Step 1 — Objects draw karo: do arrows aur unke beech ka angle

KYA. Do arrows, $\mathbf{a}$ aur $\mathbf{b}$, ko tail-to-tail rakho (ek hi point se shuru karte hue). Unke beech ki opening woh angle hai jise hum $\theta$ (Greek letter "theta", bas uss angle ka ek naam) kehte hain.

KYUN. Do vectors ke baare mein jo bhi geometric baat hai — kya woh aligned hain? Opposite hain? Right angle par hain? — woh sab is ek angle ke andar rehti hai. Agar hum $\theta$ ko numbers se nikaal sakein, toh hum pair ko poori tarah samajh lete hain.

PICTURE. Figure mein do arrows ek tail share karte hain. Shaded wedge $\theta$ hai.

$\underset{\text{pehla arrow}}{\underbrace{\mathbf{a}}},\underset{\text{doosra arrow}}{\underbrace{\mathbf{b}}},\underset{\text{unke beech ka angle, }0\le \theta \le 180^{\circ }}{\underbrace{\theta }}$

Dhyaan do ki $\theta$ $0^{\circ }$ (arrows ek doosre ke upar) se $180^{\circ }$ (arrows bilkul opposite direction mein) tak hota hai. Hume kabhi isse bade angles ki zaroorat nahi: do arrows ke beech ki sabse choti opening hamesha usi range mein hoti hai.

---

Step 2 — Do recipes jinhe hum connect karna chahte hain

KYA. Dot product likhne ke do tarike hain. Hum dono display karte hain aur aim karte hain yeh dikhane ka ki woh equal hain.

KYUN. Ek recipe compute karna aasaan hai; doosri samajhna aasaan hai. Inhe connect karna hi is page ka poora point hai.

PICTURE. Left panel: components par "multiply-and-add" recipe. Right panel: geometry par "lengths-times-cosine" recipe.

$\underset{\text{ek number}}{\underbrace{\mathbf{a}\cdot \mathbf{b}}}=\underset{\text{recipe A: matching components multiply karo, add karo}}{\underbrace{a_1{b}_1+a_2{b}_2}}\stackrel{?}{=}\underset{\text{recipe B: lengths}\times \cos \theta }{\underbrace{\Vert \mathbf{a}\Vert \Vert \mathbf{b}\Vert \cos \theta }}$

• $a_1{b}_1$ — horizontal parts ek saath multiply hue.
• $a_2{b}_2$ — vertical parts ek saath multiply hue.
• $\Vert \mathbf{a}\Vert ,\Vert \mathbf{b}\Vert$ — do arrow ki lengths.
• $\cos \theta$ — ek number $-1$ aur $1$ ke beech jo angle report karta hai; isse hum aage explain karte hain.

$\stackrel{?}{=}$ ek promise hai jo humne abhi tak puri nahi ki. Steps 4–7 ise poora karte hain.

---

Step 3 — Woh ek identity jo sab kuch pay karta hai: $\mathbf{a}\cdot \mathbf{a}=\Vert \mathbf{a}{\Vert }^2$

KYA. Ek vector ko uski khud ki self mein recipe A mein daalo: $\mathbf{a}\cdot \mathbf{a}=a_1{a}_1+a_2{a}_2=a_1^2+a_2^2.$

KYUN. Us right triangle par Pythagorean theorem se jiske legs $a_1$ aur $a_2$ hain, woh sum $\mathbf{a}$ ki squared length hi hai. (Closely related Triangle inequality — ki triangle ki koi bhi side doosri do sides ke sum se zyada nahi ho sakti — ek alag result hai; yahan humein Pythagoras chahiye, right-angle length rule.) Toh dot product pehle se apne andar "length" carry karta hai — yeh woh hinge hai jis par poora derivation swing karta hai.

PICTURE. Arrow $\mathbf{a}$ ek right triangle ka hypotenuse hai jiske legs $a_1$ (horizontal) aur $a_2$ (vertical) hain. Legs par ke squares add hokar hypotenuse par ke square ke barabar hain.

$\underset{\text{recipe A jahan }\mathbf{b}=\mathbf{a}}{\underbrace{\mathbf{a}\cdot \mathbf{a}}}=\underset{\text{legs squared, add kiye}}{\underbrace{a_1^2+a_2^2}}=\underset{\text{hypotenuse squared (Pythagoras)}}{\underbrace{\Vert \mathbf{a}{\Vert }^2}}$

---

Step 4 — Ek triangle banao taaki Law of cosines enter kar sake

KYA. $\mathbf{a}$ aur $\mathbf{b}$ ko phir se tail-to-tail draw karo, phir arrow $\mathbf{a}-\mathbf{b}$ draw karo. Geometrically $\mathbf{a}-\mathbf{b}$ woh arrow hai jo $\mathbf{b}$ ki tip se $\mathbf{a}$ ki tip tak jaata hai — yeh triangle ko close karta hai.

KYUN. Humein angle $\theta$ (geometry) aur components (algebra) ke beech ek bridge chahiye. Law of Cosines woh bridge hai: woh ek theorem hai jo triangle ki teen side lengths ko uske ek angle se relate karta hai. Ise use karne ke liye, pehle humein ek triangle chahiye — toh hum ek aisa banate hain jiska angle hi hamara $\theta$ ho.

PICTURE. Teen sides: $\mathbf{a}$, $\mathbf{b}$, aur closing side $\mathbf{a}-\mathbf{b}$. Angle $\theta$ $\mathbf{a}$ aur $\mathbf{b}$ ke beech baitha hai, closing side ke directly opposite.

$\text{sides: }\underset{\text{ek leg}}{\underbrace{\Vert \mathbf{a}\Vert }},\underset{\text{doosra leg}}{\underbrace{\Vert \mathbf{b}\Vert }},\underset{\text{woh side jo }\theta \text{ ke saamne hai}}{\underbrace{\Vert \mathbf{a}-\mathbf{b}\Vert }}$

---

Step 5 — Law of Cosines apply karo (bridge ka geometry side)

KYA. Sides $p,q$ aur included angle $\theta$, opposite side $r$ wale triangle ke liye Law of Cosines kehta hai $r^2=p^2+q^2-2pq\cos \theta$. $p=\Vert \mathbf{a}\Vert$, $q=\Vert \mathbf{b}\Vert$, $r=\Vert \mathbf{a}-\mathbf{b}\Vert$ daalo:

$\underset{\text{opposite side, squared}}{\underbrace{\Vert \mathbf{a}-\mathbf{b}{\Vert }^2}}=\underset{\text{do legs squared}}{\underbrace{\Vert \mathbf{a}{\Vert }^2+\Vert \mathbf{b}{\Vert }^2}}-\underset{\text{woh correction jo }\theta \text{ hold karta hai}}{\underbrace{2\Vert \mathbf{a}\Vert \Vert \mathbf{b}\Vert \cos \theta }}$

KYUN. Yeh equation woh akela jagah hai jahan angle $\theta$ appear hota hai. Agar hum left side ko ek alag tarike se — bina $\theta$ ke — compute kar sakein toh hum $\cos \theta$ ke liye solve kar sakte hain. Woh alag tarika recipe A hai, jo Step 6 mein aata hai.

PICTURE. Wahi triangle, ab teen squared side-lengths labeled hain aur cosine correction term $\theta$ ki taraf waali side par highlight hai.

• Jab $\theta =90^{\circ }$ hota hai, $\cos \theta =0$ aur correction vanish ho jaata hai — formula wapas plain Pythagoras ban jaata hai. Accha sanity check hai.

---

Step 6 — Algebraically wahi left side compute karo (bridge ka component side)

KYA. Step 3 ki hinge identity (length squared $=$ dot with itself) aur distributivity use karke $\Vert \mathbf{a}-\mathbf{b}{\Vert }^2$ expand karo:

$$\begin{array}{rlrl}\Vert \mathbf{a}-\mathbf{b}{\Vert }^2& =(\mathbf{a}-\mathbf{b})\cdot (\mathbf{a}-\mathbf{b})& & {\text{(hinge: length}}^2=\text{self-dot)}\\ & =\mathbf{a}\cdot \mathbf{a}\underset{=-2(\mathbf{a}\cdot \mathbf{b})}{\underbrace{-\mathbf{a}\cdot \mathbf{b}-\mathbf{b}\cdot \mathbf{a}}}+\mathbf{b}\cdot \mathbf{b}& & \text{(distribute, dot is commutative)}\\ & =\Vert \mathbf{a}{\Vert }^2-2(\mathbf{a}\cdot \mathbf{b})+\Vert \mathbf{b}{\Vert }^2.& & \text{(hinge again on the ends)}\end{array}$$

Term by term: $(\mathbf{a}-\mathbf{b})\cdot (\mathbf{a}-\mathbf{b})$ distribute karne se chaar dots milte hain — $\mathbf{a}\cdot \mathbf{a}$, phir $-\mathbf{a}\cdot \mathbf{b}$, phir $-\mathbf{b}\cdot \mathbf{a}$, phir $\mathbf{b}\cdot \mathbf{b}$. Kyunki dot product commutative hai, $\mathbf{a}\cdot \mathbf{b}=\mathbf{b}\cdot \mathbf{a}$, isliye beech ke do terms dono $-\mathbf{a}\cdot \mathbf{b}$ hain aur $-2(\mathbf{a}\cdot \mathbf{b})$ mein add ho jaate hain. Do end terms hinge identity se $\Vert \mathbf{a}{\Vert }^2$ aur $\Vert \mathbf{b}{\Vert }^2$ ban jaate hain.

KYUN. Humne ab exactly ek hi quantity $\Vert \mathbf{a}-\mathbf{b}{\Vert }^2$ ko do tarike se likha hai: ek baar $\cos \theta$ ke saath (Step 5), ek baar raw dot product $\mathbf{a}\cdot \mathbf{b}$ ke saath (yahan). Ek cheez ke liye do expressions equal hone chahiye — woh equality hi poora formula hai.

PICTURE. Expansion ek $2\times 2$ grid of pairings ke roop mein dikhaya gaya hai (vectors ke liye FOIL ki tarah): do diagonal boxes length-squared terms dete hain, do off-diagonal boxes $-2(\mathbf{a}\cdot \mathbf{b})$ mein merge ho jaate hain.

---

Step 7 — Unhe equal karo aur dekho do terms cancel ho jaate hain

KYA. Step 5 aur Step 6 ko equate karo:

$\Vert \mathbf{a}{\Vert }^2+\Vert \mathbf{b}{\Vert }^2-2\Vert \mathbf{a}\Vert \Vert \mathbf{b}\Vert \cos \theta =\Vert \mathbf{a}{\Vert }^2-2(\mathbf{a}\cdot \mathbf{b})+\Vert \mathbf{b}{\Vert }^2.$

$\Vert \mathbf{a}{\Vert }^2$ aur $\Vert \mathbf{b}{\Vert }^2$ dono sides par appear hote hain — unhe subtract kar do:

$-2\Vert \mathbf{a}\Vert \Vert \mathbf{b}\Vert \cos \theta =-2(\mathbf{a}\cdot \mathbf{b}).$

Dono sides ko $-2$ se divide karo:

$\boxed{\mathbf{a}\cdot \mathbf{b}=\Vert \mathbf{a}\Vert \Vert \mathbf{b}\Vert \cos \theta }$

KYUN. Step 2 ki promise ab poori ho gayi: recipe A ($\mathbf{a}\cdot \mathbf{b}$, components se) equals recipe B ($\Vert \mathbf{a}\Vert \Vert \mathbf{b}\Vert \cos \theta$, geometry). Dot product secretly angle ko jaanta hai.

PICTURE. Do bade expressions stack kiye gaye hain jisme shared terms greyed out hain (cancelled) aur surviving terms glow kar rahe hain, arrow boxed result ki taraf point kar raha hai.

• $\mathbf{a}\cdot \mathbf{b}$ — woh number jo recipe A produce karta hai.
• $\Vert \mathbf{a}\Vert \Vert \mathbf{b}\Vert$ — hamesha positive (lengths), isliye dot product ka sign $\cos \theta$ ka sign hota hai.
• $\cos \theta$ — alignment dial.

---

Step 8 — Saare cases: sign ko ek compass ki tarah padho

KYA. Kyunki $\Vert \mathbf{a}\Vert \Vert \mathbf{b}\Vert \ge 0$, $\mathbf{a}\cdot \mathbf{b}$ ka sign poori tarah $\cos \theta$ ka sign hai. Chalo har case walk karte hain, degenerate wale bhi.

KYUN. Contract yeh hai: reader ko koi aisi situation nahi milni chahiye jo humne skip ki ho. Yahan sab hain.

PICTURE. Paanch mini-panels: acute, right, obtuse, aur do extremes (same direction, opposite direction).

Recall Quick self-test

Agar $\mathbf{a}\cdot \mathbf{b}<0$ ho, toh angle acute, right, ya obtuse hai? ::: Obtuse ($90^{\circ }$ aur $180^{\circ }$ ke beech), kyunki $\cos \theta <0$. Do nonzero perpendicular vectors ka dot product kitne ke barabar hota hai? ::: Zero. $\Vert \mathbf{a}\Vert \Vert \mathbf{b}\Vert$ kabhi negative kyun nahi hota? ::: Dono lengths hain, aur length hamesha $\ge 0$ hoti hai.

---

Ek-picture summary

Upar ki sab cheez ek single diagram mein collapse ho jaati hai: shared-tail triangle geometry carry karta hai ($\theta$, Law of Cosines), component grid algebra carry karta hai ($a_1{b}_1+a_2{b}_2$), aur dono beech mein boxed identity par milte hain.

$\underset{\text{algebra: multiply \& add}}{\underbrace{a_1{b}_1+a_2{b}_2}}=\mathbf{a}\cdot \mathbf{b}=\underset{\text{geometry: lengths \& angle}}{\underbrace{\Vert \mathbf{a}\Vert \Vert \mathbf{b}\Vert \cos \theta }}$

Recall Feynman retelling — poora walkthrough plain words mein

Do arrows ko ek hi dot se shuru hote hue imagine karo. Hum ek honest number chahte the jo yeh kahe ki "yeh do kitna same direction mein point karte hain?" Hmare paas uss number ke liye do ideas the. Idea A: unke sideways parts aur up-down parts line up karo, har pair multiply karo, add karo — pure arithmetic. Idea B: do arrow lengths multiply karo aur phir unke beech ke angle ke cosine se answer ko upar ya neeche dial karo — pure geometry.

Yeh dikhane ke liye ki yeh ek hi number hain, humein angle aur arithmetic ke beech ek bridge chahiye tha. Toh humne woh triangle draw kiya jo do arrows aur unki tips ko join karne wali line se banta hai. Woh teesri side, tip to tip, "$\mathbf{a}$ minus $\mathbf{b}$" hai. Ab Law of Cosines — woh ek rule jo triangle ki sides ko uske angle se link karta hai — humein uss teesri side ki length squared deta hai, usme angle likha hota hai. Lekin hum wahi squared length pure arithmetic se bhi compute kar sakte hain (ek vector ki length squared bas khud se dot ki gai hoti hai). Ek cheez ko likhne ke do tarike matlab woh equal hain. Jab hum unhe equal karte hain, "$\mathbf{a}$ ki length squared" aur "$\mathbf{b}$ ki length squared" dono sides par aate hain aur cancel ho jaate hain, aur jo bachta hai, minus two se divide karne ke baad, woh famous line hai: dot product equals length times length times cosine.

Phir humne angle ke har mood ko check kiya. Same taraf jhuke → positive. Square corner → exactly zero. Fight kar rahe → negative. Perfectly aligned ya perfectly opposite → lengths ki jo sabse badi positive ya sabse badi negative allow karti hain. Aur agar ek arrow shrinked hokar kuch nahi ban jaata, geometry apna angle khoti hai lekin arithmetic calm rehti hai aur zero return karti hai. Isliye hum algebra ko real definition ke roop mein trust karte hain aur beautiful cosine picture ko uska meaning maante hain.

---

Connections

• $\cos \theta$ mein chupi projection idea Vector projection mein develop ki gayi hai.
• Zero-dot-product case Orthogonality and orthonormal bases ka seed hai.
• "Dot product se angle define karo" ka abstract version Inner product spaces mein rehta hai.
• Yahan ki angle machinery Cross product ki area/normal machinery se contrast karti hai.
• Yeh walkthrough Law of cosines par lean karta hai aur Triangle inequality se connect hota hai.