4.5.14Linear Algebra (Full)

Rank-nullity theorem — proof

1,932 words9 min readdifficulty · medium6 backlinks

WHAT is the theorem?

  • kerT\ker T is a subspace of VV (the input side).
  • imT\operatorname{im} T is a subspace of WW (the output side).
  • Note both numbers add up to dimV\dim Vthe dimension of the domain, not the codomain WW.

WHY should it be true? (intuition before rigour)


HOW to prove it — derivation from scratch

We build it carefully. The key trick is the Basis Extension Theorem: any basis of a subspace can be extended to a basis of the whole space.


Figure — Rank-nullity theorem — proof

Worked examples


Common mistakes (steel-manned)


Recall Feynman: explain it to a 12-year-old

Imagine a machine with 3 input levers (3 dimensions of input). When you push the levers, some pushes do nothing — the machine ignores them (those are the "kernel" levers). The pushes that do something make the output move. The big idea: every lever is either ignored or makes a unique new output. So (ignored levers) + (useful levers) = (total levers). That's the whole theorem!


Active-recall flashcards

#flashcards/maths

What does the rank–nullity theorem state?
For a linear map T:VWT:V\to W with VV finite-dimensional, rank(T)+nullity(T)=dimV\operatorname{rank}(T)+\operatorname{nullity}(T)=\dim V.
Rank is the dimension of which space?
The image (range) of TT, dim(imT)\dim(\operatorname{im}T).
Nullity is the dimension of which space?
The kernel (null space) of TT, dim(kerT)\dim(\ker T).
The sum equals the dimension of the domain or the codomain?
The domain VV.
What theorem lets us extend a kernel basis to a basis of VV?
The basis-extension theorem.
In the proof, what set is shown to be a basis of the image?
{T(v1),,T(vnk)}\{T(v_1),\dots,T(v_{n-k})\}, images of the basis vectors outside the kernel.
Why do the T(vj)T(v_j) span the image?
Any vv splits into kernel part (mapped to 0) plus the vjv_j part, so every output is a combination of the T(vj)T(v_j).
Why are the T(vj)T(v_j) independent?
If cjT(vj)=0\sum c_j T(v_j)=0 then cjvjkerT\sum c_j v_j\in\ker T; writing it via the uiu_i and using full-basis independence forces all cj=0c_j=0.
For a 2×32\times3 matrix of rank 1, what is its nullity?
31=23-1=2.
Is independence of vectors always preserved by a linear map?
No; a map can collapse independent vectors — that's why the proof argues via the kernel.

Connections

Concept Map

has

has

dim = nullity k

dim = n

extend via

gives

apply T to survivors

proven to

proven to

so basis of image

so basis of image

dim = rank = n-k

contributes k

Finite-dim V, dim = n

Linear map T:V to W

Kernel of T, subspace of V

Image of T, subspace of W

Basis Extension Theorem

Kernel basis u1..uk

Full basis of V

Set T of v1..v n-k

Spans image T

Linearly independent

rank + nullity = dim V

Hinglish (regional understanding)

Intuition Hinglish mein samjho

Dekho, rank–nullity theorem ka idea bahut simple hai. Maan lo tumhare paas ek linear map T:VWT:V\to W hai. VV ka dimension nn hai matlab nn independent input directions hain. Jab tum inko TT se nikaalte ho, do hi cheezein ho sakti hain: ya to ek direction zero ban jaati hai (yeh kernel hai), ya phir wo output me zinda bachti hai (yeh image banati hai). Theorem kehta hai: kernel ka dimension (nullity) plus image ka dimension (rank) hamesha barabar hota hai dimV\dim V ke. Kuch bhi dimension na khoti hai na banti — bas sort ho jaati hai.

Proof ka asli trick basis extension hai. Pehle kernel ka basis lo: u1,,uku_1,\dots,u_k. Phir isko extend karke poore VV ka basis bana lo by adding v1,,vnkv_1,\dots,v_{n-k}. Ab claim yeh hai ki T(v1),,T(vnk)T(v_1),\dots,T(v_{n-k}) image ka basis ban jaata hai. Spanning easy hai — kyunki T(ui)=0T(u_i)=0, har output sirf T(vj)T(v_j) ka combination hota hai. Independence ke liye, agar cjT(vj)=0\sum c_j T(v_j)=0 ho, to cjvj\sum c_j v_j kernel me chala jaata hai, aur full basis ki independence use karke saare cjc_j zero ho jaate hain.

Yeh kyun important hai? Kyunki bina system solve kiye tum nullity nikaal sakte ho: nullity=nrank\text{nullity}=n-\text{rank}. Matrix me rank = pivots ki ginti, to free variables turant mil jaate hain. Aur ek bada result: square matrix ke liye injective hona aur surjective hona equivalent ho jaata hai — yeh sab rank–nullity se aata hai.

Yaad rakhna: sum hamesha domain VV ke dimension ke barabar hota hai, WW ke nahi. Yeh sabse common galti hai. Aur ek aur baat — independent vectors hamesha independent nahi rehte TT ke baad, isiliye proof me kernel wala careful argument lagana padta hai.

Go deeper — visual, from zero

Test yourself — Linear Algebra (Full)

Connections