Dot product and its geometric meaning (projection, angle)

1.1.3 · AI-ML › Linear Algebra Essentials

Dot product HAI kya?

HUM kyun care karte hain (AI-ML wajah)? Cosine similarity, gradient descent (gradient ka kisi direction ke saath dot), attention scores (query·key), aur principal components par projections — ye sab dot products hain. Ise master karo aur ML geometry ka aadha hissa unlock ho jaayega.

Do definitions agree kyun karte hain — scratch se derivation

Hum geometric form derive karte hain Law of Cosines use karke. Wo triangle socho jo $a$ , $b$ , aur vector $a - b$ (unke tips ko connect karne wali side) se banta hai.

Step 1 — Law of cosines. Angle $θ$ ke opposite wali side ki length: $∥ a - b ∥^{2} = ∥ a ∥^{2} + ∥ b ∥^{2} - 2∥ a ∥∥ b ∥ cos θ$ Ye step kyun? Ye pure geometry hai — Pythagoras ka generalization jab angle $90°$ na ho.

Step 2 — Left side ko algebraically expand karo. $∥ v ∥^{2} = v \cdot v$ use karke: $∥ a - b ∥^{2} = (a - b) \cdot (a - b) = a \cdot a - 2 a \cdot b + b \cdot b$ Ye step kyun? Dot product bilkul multiplication ki tarah distribute hota hai, toh hum ise FOIL kar sakte hain. $= ∥ a ∥^{2} - 2 a \cdot b + ∥ b ∥^{2}$

Step 3 — Dono expressions ko equate karo aur $∥ a ∥^{2} + ∥ b ∥^{2}$ cancel karo: $- 2 a \cdot b = - 2∥ a ∥∥ b ∥ cos θ$ $a \cdot b = ∥ a ∥∥ b ∥ cos θ$ Ye step kyun? $- 2$ se divide karne par result isolate ho jaata hai. Algebraic sum $\sum a_{i} b_{i}$ aur geometric $∥ a ∥∥ b ∥ cos θ$ provably identical hain.

Angle aur cosine similarity

Angle ke liye boxed formula solve karo: $cos θ = \frac{a \cdot b}{∥ a ∥ ∥ b ∥}$

Projection — " $a$ ka kitna hissa $b$ ke along hai"

Derivation. Scalar projection wo length hai jo $a$ ki $b$ ki direction mein hoti hai: $comp_{b} a = ∥ a ∥ cos θ$ Kyun? Basic trig: adjacent side = hypotenuse $\times cos$ . Ab $cos θ = \frac{a \cdot b}{∥ a ∥∥ b ∥}$ substitute karo: $comp_{b} a = ∥ a ∥ \cdot \frac{a \cdot b}{∥ a ∥∥ b ∥} = \frac{a \cdot b}{∥ b ∥}$

Vector projection unit vector $\hat{b} = b /∥ b ∥$ ki direction mein point karta hai: $proj_{b} a = (\frac{a \cdot b}{∥ b ∥}) \frac{b}{∥ b ∥} = \frac{a \cdot b}{b \cdot b} b$ $b \cdot b$ kyun? Kyunki $∥ b ∥^{2} = b \cdot b$ — ye cleaner hai aur square roots se bachata hai.

Figure — Dot product and its geometric meaning (projection, angle)

Worked examples

Common mistakes (steel-manned)

Active recall

Recall Reveal karne se pehle predict karo (Forecast-then-Verify)

$(1, 0, 0) \cdot (0, 1, 0)$ kya hai aur ye kya batata hai?
$∥ v ∥^{2}$ ko dot product use karke rewrite karo.
Vector projection mein hum $b \cdot b$ se kyun divide karte hain?

Answers: 1) $0$ → orthogonal axes. 2) $∥ v ∥^{2} = v \cdot v$ . 3) Kyunki $∥ b ∥^{2} = b \cdot b$ , aur hume $b$ ko unit length tak scale karna hota hai do baar (ek baar direction ke liye, ek baar comp ke andar).

Recall Feynman: 12-saal ke bachche ko samjhao

Socho do log ek shopping cart dhakka de rahe hain. Agar wo same direction mein push karen, toh cart tezi se chalti hai — dot product bada hoga. Agar ek doosre ke sideways push kare, toh wo sideways push kisi kaam ka nahi — dot product zero. Agar wo ek doosre ke against push karen, toh dot product negative ho jaata hai. Dot product bas measure karta hai kitni teamwork same direction mein hai, times kitna zor lagaa raha hai har ek.

Flashcards

Dot product ki do equivalent definitions kya hain?

Algebraic

\sum a_{i} b_{i}

aur geometric

∥ a ∥∥ b ∥ cos θ

Zero dot product ka geometrically kya matlab hai?

Vectors orthogonal hain (perpendicular,

θ = 90°

Do vectors ke beech angle ka formula kya hai?

cos θ = \frac{a \cdot b}{∥ a ∥∥ b ∥}

a

b

par vector projection kya hai?

proj_{b} a = \frac{a \cdot b}{b \cdot b} b

a

b

ke along scalar projection (component) kya hai?

\frac{a \cdot b}{∥ b ∥}

ML mein raw dot product ki jagah cosine similarity kyun use karte hain?

Ye magnitude remove karta hai, sirf direction compare karta hai; range

[- 1, 1]

Negative dot product kya indicate karta hai?

Angle obtuse hai (

> 90°

); vectors partly ek doosre se door point karte hain.

∥ v ∥^{2}

ko dot product ke roop mein express karo.

v \cdot v

Do dot-product definitions ko equal prove karne ke liye kaun sa law use hota hai?

Law of Cosines.

Kya

proj_{b} a = proj_{a} b

hota hai?

Nahi — target vector ki length denominator mein hoti hai, isliye wo alag hote hain.

Connections

Vector norms and length — $∥ v ∥ = v \cdot v$ seedha dot product se aata hai.
Cosine similarity and embeddings — direct ML application.
Orthogonality and orthonormal bases — dot product $= 0$ hi definition hai.
Matrix multiplication as dot products — $A B$ ki har entry ek row·column dot product hai.
Gradient descent — directional derivative $\nabla f \cdot d$ hai.
Attention mechanism — query·key scores dot products hain.