4.5.25Linear Algebra (Full)

Invertible matrix theorem — 12+ equivalent conditions

2,158 words10 min readdifficulty · medium3 backlinks

What we are claiming

Crucial caveat: this theorem is only for square matrices. A 3×53\times 5 matrix can have independent columns or spanning columns but never both, so the IMT does not apply.


WHY are all these the same thing? (Derivation from scratch)

We don't memorize 17 facts. We build a logical loop so that following the arrows proves them all equivalent. We never need a bare formula — each link has a reason.

Figure — Invertible matrix theorem — 12+ equivalent conditions

Suppose A1A^{-1} exists and Ax=0Ax=\mathbf 0. Multiply both sides on the left by A1A^{-1}: A1Ax=A10    Ix=0    x=0.A^{-1}Ax = A^{-1}\mathbf 0 \implies Ix = \mathbf 0 \implies x=\mathbf 0. Why this step? Left-multiplying by the inverse "undoes" AA and isolates xx. So no nonzero vector can be killed by AA.

Write A=[a1 a2  an]A=[\,a_1\ a_2\ \cdots\ a_n\,] with columns aia_i. Then Ax=x1a1+x2a2++xnan.Ax = x_1 a_1 + x_2 a_2 + \cdots + x_n a_n. Why this step? Matrix–vector multiplication is a linear combination of the columns weighted by entries of xx. So Ax=0Ax=\mathbf 0 means a combination of columns equals zero. "Only x=0x=\mathbf 0 works" is exactly the definition of linear independence.

nn independent columns means no column is a free (non-pivot) column, so all nn columns are pivot columns. For an n×nn\times n matrix, nn pivots fill every row and column, and the reduced row echelon form must be InI_n. Why this step? A free column would give a nonzero null-space vector, contradicting independence.

If AIA \sim I, then a sequence of elementary row operations turns AA into II. Each operation = multiply by an invertible elementary matrix EiE_i: EkE2E1A=I.E_k\cdots E_2 E_1 A = I. Let B=EkE1B = E_k\cdots E_1 (a product of invertibles, hence invertible). Then BA=IBA=I, so B=A1B=A^{-1}. Why this step? Row operations are reversible — that's why each EiE_i is invertible — so their product is a genuine inverse.

Loop closed: 1453211\Rightarrow4\Rightarrow5\Rightarrow3\Rightarrow2\Rightarrow1. All five are equivalent. ✔

Hooking on the rest

  • 6 (injective) \equiv 4: a linear map is one-to-one iff its kernel is {0}\{\mathbf 0\} (if Au=AvAu=Av then A(uv)=0A(u-v)=\mathbf 0).
  • 7, 8, 9: "solution for every bb" means every bb is a column combination \Rightarrow columns span \Rightarrow map is onto. For a square matrix, nn pivots simultaneously give independence and spanning — that's why injective and surjective coincide here.
  • 13 (det0\det\neq0): elementary operations scale det\det by nonzero factors; detI=1\det I=1. So AI    detA0A\sim I \iff \det A\neq 0.
  • 14: detA=(eigenvalues)\det A=\prod(\text{eigenvalues}), so detA0    \det A\neq0 \iff no eigenvalue is 00. Also 00 eigenvalue means x0, Ax=0x=0\exists x\neq0,\ Ax=0x=\mathbf0 — a nonzero null vector, contradicting (4).
  • 12 (ATA^{\mathsf T}): row rank == column rank, and detAT=detA\det A^{\mathsf T}=\det A.
  • 15, 16, 17: rank =n=n ⟺ pivots fill columns ⟺ columns are a basis ⟺ dimNulA=0\dim\operatorname{Nul}A=0.

Worked Examples


Common Mistakes (Steel-manned)


Recall Feynman: explain to a 12-year-old

Imagine a machine that takes any LEGO model and rearranges its bricks into a new model. A good machine never destroys information: from the output you can always rebuild the exact input — that's an invertible machine. A bad machine sometimes squashes two different inputs into the same output, so you can't undo it. The amazing thing: there are many different ways to test whether the machine is "good," like "does it ever turn a non-empty model into nothing?", "can it produce every possible model?", "do its building rules overlap?" — and for square machines all these tests give the same yes/no answer. So you just pick the easiest test to run.


Active-Recall Flashcards

For a square matrix, what does Ax=0Ax=\mathbf 0 having only x=0x=\mathbf 0 imply?
It is invertible — and equivalently its columns are independent, det0\det\neq0, rank =n=n, etc. (IMT).
Why does the IMT require the matrix to be square?
Only for n×nn\times n do "independent columns" and "spanning columns" coincide; non-square matrices can satisfy one but never both.
Give the determinant criterion of the IMT.
AA invertible     detA0\iff \det A \neq 0.
What about eigenvalues tells you a matrix is invertible?
00 is NOT an eigenvalue (since Ax=0xAx=0x would give a nonzero null vector).
If a square matrix AA satisfies AD=IAD=I, is it invertible?
Yes — for square matrices a one-sided inverse is automatically two-sided (conditions 10/11).
How does Ax=Ax= "linear combination of columns" power the proof that null={0}=\{0\} ⟺ independent columns?
Because Ax=x1a1++xnanAx=x_1a_1+\dots+x_na_n, so Ax=0Ax=\mathbf0 is exactly a dependence relation among columns.
What is the rank condition for invertibility?
rankA=n\operatorname{rank}A = n (full rank / pivot in every column).
Why is checking det\det a smart shortcut?
It's one cheap computation that, by the IMT, decides ALL the equivalent properties at once.
If columns of a square AA span Rn\mathbb R^n, are they independent?
Yes — for square matrices spanning ⟺ independent ⟺ invertible.
RREF of an invertible matrix is?
The identity matrix InI_n.

Connections

Concept Map

left-multiply A^-1

Ax as column combo

no free variables

RREF reduces to I

pivot each row+col

full rank

every b reachable

Col A = R^n

det multiplicative

det = product of eigenvalues

required for

A invertible

Trivial null space

Columns independent

Map injective

Row equiv to I

n pivot positions

Columns span R^n

Map surjective

det A not 0

0 not an eigenvalue

rank A = n

Square matrix only

Hinglish (regional understanding)

Intuition Hinglish mein samjho

Dekho, Invertible Matrix Theorem ka asli mazaa yeh hai ki ek square matrix AA ke baare mein 15-17 alag-alag sounding cheezein actually ek hi baat hain. Yaani agar matrix invertible hai, toh uska determinant non-zero hoga, rank pura nn hoga, columns linearly independent honge, Ax=0Ax=0 ka sirf trivial solution hoga, columns poora Rn\mathbb R^n span karenge, aur 00 uski koi eigenvalue nahi hogi. Aur agar invertible nahi hai, toh yeh saari properties ek saath fail ho jaati hain. Koi beech ka raasta nahi.

Iska practical fayda? Tumhe A1A^{-1} nikalne ki zaroorat nahi — woh mehnga kaam hai. Bas jo condition sabse aasaan ho woh check kar lo. Chhote matrix ke liye det\det nikaal lo; agar columns mein koi obvious dependence dikh rahi hai (jaise ek column doosre ka multiple), toh seedha bol do "not invertible". Ek hi test sab kuch bata deta hai.

Proof ka dil yeh hai ki hum ek loop banate hain: invertible \Rightarrow null space zero \Rightarrow independent columns \Rightarrow nn pivots \Rightarrow RREF =I=I \Rightarrow wapas invertible. Yeh loop band ho gaya, matlab saare steps aapas mein equivalent. Yaad rakhna trick: AxAx actually columns ka linear combination hota hai, isi liye "Ax=0Ax=0 ka sirf trivial solution" aur "columns independent" exactly same baat hai.

Sabse important warning: yeh theorem sirf square matrices ke liye hai. 3×53\times 5 wale matrix par mat lagana — wahan independence aur spanning dono kabhi saath nahi aate. Toh pehle check karo matrix square hai ya nahi, phir IMT ka jaadu use karo.

Go deeper — visual, from zero

Test yourself — Linear Algebra (Full)

Connections