1.1.7 · AI-ML › Linear Algebra Essentials
Transpose ek matrix ko uski main diagonal ke across flip karta hai : rows ban jaati hain columns aur columns ban jaati hain rows. Kuch add ya destroy nahi hota — tum bas relabelling kar rahe ho ki kaun sa index pehle aata hai. Baaki sab cheezein ("reverse-order" rule, symmetry, dot products) is ek hi flip se nikal aati hain.
Ek matrix A jiska shape m × n hai aur entries A ij hain (row i , column j ), uska transpose A ⊤ ek n × m matrix hai jo is tarah define hota hai:
( A ⊤ ) ij = A j i .
A ⊤ ke row i , column j wali entry, A ke row j , column i wali entry hoti hai.
Yeh definition KYU? Main diagonal (entries A ii ) apni jagah rahi — ek "mirror line" ki tarah. Off-diagonal entries apne partners se swap karti hain: jo ( j , i ) pe tha woh ( i , j ) pe aa jaata hai. Isliye shape m × n se n × m ho jaata hai.
Worked example Basic flip
A = [ 1 4 2 5 3 6 ] ( 2 × 3 ) ⟹ A ⊤ = 1 2 3 4 5 6 ( 3 × 2 ) .
Yeh step kyun? A ki Row 1 hai ( 1 , 2 , 3 ) ; yeh A ⊤ ki column 1 ban jaati hai. Check karo: ( A ⊤ ) 21 = A 12 = 2 . ✓
Neeche sab kuch ek hi rule ( A ⊤ ) ij = A j i se prove kiya gaya hai. Kuch bhi raatna nahi hai.
( ( A ⊤ ) ⊤ ) ij = ( A ⊤ ) j i = A ij ⟹ ( A ⊤ ) ⊤ = A .
Kyun? Do baar flip karne se har entry apne ghar wapas aa jaati hai. Isliye ⊤ ek involution hai.
(( A + B ) ⊤ ) ij = ( A + B ) j i = A j i + B j i = ( A ⊤ ) ij + ( B ⊤ ) ij .
Kyun? Transpose sirf entries ko move karta hai; addition entry-by-entry hoti hai, isliye dono operations commute karti hain.
Matrix-product definition ( A B ) ij = ∑ k A ik B k j se shuru karte hain:
( ( A B ) ⊤ ) ij = ( A B ) j i = ∑ k A j k B k i .
Ab transpose rule se har factor ko rewrite karo (A j k = ( A ⊤ ) k j , B k i = ( B ⊤ ) ik ):
= ∑ k ( B ⊤ ) ik ( A ⊤ ) k j = ( B ⊤ A ⊤ ) ij .
Isliye ( A B ) ⊤ = B ⊤ A ⊤ .
Intuition Order KYUN reverse hota hai
Dimensions ke baare mein socho: agar A , m × n hai aur B , n × p hai, toh A B , m × p hai, isliye ( A B ) ⊤ , p × m hoga. Transposes se p × m paane ka ek hi tarika hai: B ⊤ ( p × n ) ko A ⊤ ( n × m ) se multiply karo. Order shape-matching se forced hai — A ⊤ B ⊤ hoga hi nahi (shapes fit hi nahi honge).
A A − 1 = I ke dono sides ko rule 3 se transpose karo (aur I ⊤ = I ):
( A − 1 ) ⊤ A ⊤ = I ⟹ ( A − 1 ) ⊤ = ( A ⊤ ) − 1 .
Notation A − ⊤ is common object ka shorthand hai.
Leibniz formula permutations σ pe sum karta hai: transpose ke under har product ∏ i A i , σ ( i ) , ∏ i A σ ( i ) , i ban jaata hai, jo σ − 1 se reindex kiya hua same sum hai (same sign ke saath). Toh total identical hai.
Definition Symmetric / skew-symmetric
A symmetric hai agar A ⊤ = A (yaani A ij = A j i ).
A skew-symmetric (antisymmetric) hai agar A ⊤ = − A (yaani A ij = − A j i , jisse A ii = 0 forced hota hai).
A ⊤ A HAMESHA symmetric kyun hota hai (ML mein bahut important)
( A ⊤ A ) ⊤ = A ⊤ ( A ⊤ ) ⊤ = A ⊤ A . Isliye Gram matrices , covariance matrices , aur normal equations A ⊤ A x = A ⊤ b symmetric-matrix land mein rehte hain — jisse real eigenvalues aur orthogonal eigenvectors milte hain.
Yeh bhi: vector x ke liye, x ⊤ x = ∑ i x i 2 = ∥ x ∥ 2 . Transpose ek column ko woh machine bana deta hai jo squared length compute karta hai.
Worked example Reverse-order rule verify karo
A = [ 1 0 2 1 ] , B = [ 1 3 0 1 ] .
A B = [ 7 3 2 1 ] ⇒ ( A B ) ⊤ = [ 7 2 3 1 ] .
B ⊤ A ⊤ = [ 1 0 3 1 ] [ 1 2 0 1 ] = [ 7 2 3 1 ] . ✓
Yeh step kyun? Hum dono sides independently compute karke match karte hain — derivation confirm karte hain, assume nahi karte.
Worked example Ek matrix ko symmetric + skew mein split karo
A = [ 2 1 5 4 ] . Toh A ⊤ = [ 2 5 1 4 ] .
S = 2 1 ( A + A ⊤ ) = [ 2 3 3 4 ] (symmetric ✓), K = 2 1 ( A − A ⊤ ) = [ 0 − 2 2 0 ] (skew, zero diagonal ✓).
S + K = [ 2 1 5 4 ] = A . ✓
Yeh step kyun? Average karne se flip ke under symmetric part milta hai; aadha difference anti-part deta hai.
( A B ) ⊤ = A ⊤ B ⊤ "
Kyun sahi lagta hai: transpose linear hai, isliye students expect karte hain ki yeh sum ki tarah product mein bhi term-by-term "pass through" karega.
Fix: product entrywise nahi hai — yeh ∑ k A ik B k j se indices mix karta hai. Shape-matching reversal ko force karta hai: ( A B ) ⊤ = B ⊤ A ⊤ . Rectangular shapes se sanity-check karo aur A ⊤ B ⊤ aksar multiply hi nahi hoga.
Common mistake "Transpose determinant / eigenvalues change karta hai."
Kyun sahi lagta hai: A ⊤ alag matrix lagta hai, toh tum assume karte ho alag numbers.
Fix: det ( A ⊤ ) = det ( A ) , aur kyunki eigenvalues det ( A − λ I ) ke roots hain, A aur A ⊤ ke same eigenvalues hote hain (eigenvectors differ kar sakte hain).
Common mistake "Skew-symmetric matrix ka nonzero diagonal ho sakta hai."
Kyun sahi lagta hai: tum sirf off-diagonal sign flips pe focus karte ho.
Fix: A ii = − A ii ⇒ 2 A ii = 0 ⇒ A ii = 0 . Diagonal hamesha zero hoti hai.
Recall Feynman: 12-saal ke bacche ko samjhao
Ek class ki seating chart socho jo grid ki tarah bani hai. Har number kehta hai "yeh baccha row i , seat j mein hai." Transpose woh hota hai jo tumhe milta hai agar tum grid ko iske diagonal mirror ke saath side mein ghuma do — jaise koi photo ko 90° tilt karo. Jo baccha "row 3, seat 1" mein tha woh ab "row 1, seat 3" mein hai. Tumne koi baccha add ya remove nahi kiya, bas grid ko padhne ka tarika badla. Aur ek cool rule: agar pehle task A karo phir task B aur poori cheez flip karo, toh yeh same hai jaise B flip karo, phir A flip karo — tumhe unhe reverse order mein undo karna hoga, jaise shoes utaarne se pehle moje utaaro.
"Diagonal ke across flip karo" — diagonal entries kabhi nahi move karti.
Reverse rule: "Socks-and-shoes" — ( A B ) ⊤ = B ⊤ A ⊤ (reverse order mein undo karo).
Symmetric factory: A ⊤ A hamesha symmetric hota hai ("A-transpose-A is A-OK / symmetric").
Transpose ke liye defining entry rule kya hai? ( A ⊤ ) ij = A j i — dono indices swap karo.
Transpose ek m × n matrix ki shape kaise change karta hai? Yeh n × m ho jaati hai.
Reverse-order (socks-and-shoes) rule batao. ( A B ) ⊤ = B ⊤ A ⊤ .
Derive karo kyun ( A B ) ⊤ = B ⊤ A ⊤ hota hai na ki A ⊤ B ⊤ . ( A B ) ij ⊤ = ∑ k A j k B k i = ∑ k ( B ⊤ ) ik ( A ⊤ ) k j ; shapes bhi reversal force karti hain.
( A ⊤ ) ⊤ kya hai?A — transpose ek involution (self-inverse) hai.
A symmetric kab hota hai? Skew-symmetric kab?Symmetric: A ⊤ = A . Skew: A ⊤ = − A (zero diagonal).
A ⊤ A hamesha symmetric kyun hota hai?( A ⊤ A ) ⊤ = A ⊤ ( A ⊤ ) ⊤ = A ⊤ A .
Kisi bhi square A ko symmetric + skew parts mein kaise split karoge? A = 2 1 ( A + A ⊤ ) + 2 1 ( A − A ⊤ ) .
det ( A ) aur det ( A ⊤ ) mein kya relation hai?Dono equal hain; isliye same characteristic polynomial aur eigenvalues hote hain.
( A − 1 ) ⊤ kya hota hai?( A ⊤ ) − 1 (A A − 1 = I ko transpose karke prove hota hai).
Transpose ki inner-product / adjoint property kya hai? ⟨ A x , y ⟩ = ⟨ x , A ⊤ y ⟩ .
Skew-symmetric matrix ka diagonal zero kyun hona zaroori hai? A ii = − A ii ⇒ A ii = 0 .
Reverse-order: (AB)^T = B^T A^T
Inverse: (A^-1)^T = (A^T)^-1
Symmetry and dot products