4.5.27Linear Algebra (Full)

Linear transformations — definition, kernel, image

1,886 words9 min readdifficulty · medium6 backlinks

1. Definition

WHY these two rules? A vector space is defined by two operations: adding vectors and scaling them. A map "preserves structure" precisely when it commutes with those two operations. Nothing more, nothing less.

HOW to use the definition (Derivation: T(0)=0T(0)=0): T(0)=T(0v)=0T(v)=0.T(0) = T(0\cdot v) = 0\cdot T(v) = 0. Why this step? I wrote 00 as the scalar 00 times any vector, then pulled the scalar out (homogeneity). So every linear map sends the zero vector to the zero vector — a free sanity check.


2. Kernel (null space)

WHY is it a subspace? If T(u)=0T(u)=0 and T(v)=0T(v)=0 then T(cu+dv)=cT(u)+dT(v)=0T(cu+dv) = cT(u)+dT(v) = 0. So sums and scalings of kernel vectors stay in the kernel → it's a subspace of VV (and always contains 00).


3. Image (range)

WHY is it a subspace of WW? Any output is T(v)T(v); cT(u)+dT(v)=T(cu+dv)cT(u)+dT(v) = T(cu+dv) is again an output. Closed under the operations → subspace.

Figure — Linear transformations — definition, kernel, image

4. Rank–Nullity Theorem (the bridge)

Derivation from scratch. Let dimV=n\dim V = n. Take a basis {k1,,kp}\{k_1,\dots,k_p\} of kerT\ker T (so nullity =p=p). Extend it to a full basis of VV: {k1,,kp,w1,,wq}\{k_1,\dots,k_p, w_1,\dots,w_{q}\} with p+q=np+q=n. Claim: {T(w1),,T(wq)}\{T(w_1),\dots,T(w_q)\} is a basis of imT\operatorname{im} T.

  • They span the image: any v=aiki+bjwjv=\sum a_i k_i + \sum b_j w_j, so T(v)=aiT(ki)+bjT(wj)=bjT(wj)T(v)=\sum a_i T(k_i)+\sum b_j T(w_j)=\sum b_j T(w_j) (kernel terms vanish). Why? T(ki)=0T(k_i)=0 by definition of kernel.
  • They are independent: if bjT(wj)=0\sum b_j T(w_j)=0 then T(bjwj)=0T(\sum b_j w_j)=0, so bjwjkerT=span(ki)\sum b_j w_j\in\ker T = \operatorname{span}(k_i). Writing it as ciki\sum c_i k_i and using basis independence forces all bj=0b_j=0. So rank =q=q, hence n=p+q=n=p+q= nullity ++ rank. \blacksquare

Check on our example: dimV=3\dim V=3, nullity =1=1, rank =2=2, and 1+2=31+2=3. ✓


5. Common mistakes


6. Active recall

Recall Quick self-test (hide answers)
  • State the two defining properties of a linear map. → additivity & homogeneity.
  • Why must T(0)=0T(0)=0? → T(0v)=0T(v)=0T(0v)=0T(v)=0.
  • kerT\ker T \subseteq ? → VV. imT\operatorname{im} T\subseteq? → WW.
  • Injective iff? → kerT={0}\ker T=\{0\}.
  • Rank–nullity statement? → dimV=\dim V= nullity ++ rank.
Recall Feynman: explain to a 12-year-old

Imagine a machine that takes arrows and gives new arrows, with one fair rule: if you add two arrows first then feed them in, you get the same answer as feeding each and adding afterwards (and doubling an arrow doubles the output). The kernel is the pile of arrows that the machine squashes flat to nothing. The image is the collection of every arrow the machine is able to spit out. If only the "do-nothing" arrow gets squashed, the machine never confuses two different arrows. Counting rule: (arrows squashed) + (arrows it can make) = (arrows you started with).


Flashcards

What two properties define a linear transformation?
Additivity T(u+v)=T(u)+T(v)T(u+v)=T(u)+T(v) and homogeneity T(cv)=cT(v)T(cv)=cT(v).
Why does every linear map satisfy T(0)=0T(0)=0?
T(0)=T(0v)=0T(v)=0T(0)=T(0\cdot v)=0\cdot T(v)=0 by homogeneity.
Define the kernel of T:VWT:V\to W.
kerT={vV:T(v)=0W}\ker T=\{v\in V: T(v)=0_W\}, a subspace of VV.
Define the image of T:VWT:V\to W.
imT={T(v):vV}\operatorname{im} T=\{T(v):v\in V\}, a subspace of WW.
TT is injective if and only if ___?
kerT={0}\ker T=\{0\}.
TT is surjective if and only if ___?
imT=W\operatorname{im} T=W.
State the rank–nullity theorem.
dimV=dim(kerT)+dim(imT)\dim V=\dim(\ker T)+\dim(\operatorname{im} T) = nullity + rank.
For T(x)=AxT(x)=Ax, the image equals which familiar space?
The column space of AA.
Why is the kernel a subspace?
If T(u)=T(v)=0T(u)=T(v)=0 then T(cu+dv)=cT(u)+dT(v)=0T(cu+dv)=cT(u)+dT(v)=0, closed under combinations.
Why is T(x)=Ax+bT(x)=Ax+b (with b0b\neq0) not linear?
T(0)=b0T(0)=b\neq0, violating T(0)=0T(0)=0.

Connections

Concept Map

structure preserved by

requires

requires

derives

determined by basis gives

has

has

equals zero iff

equals W iff

is a

is a

Vector spaces V W over F

Linear transformation T

Additivity

Homogeneity

T of 0 equals 0

Matrix A columns T of e_i

Kernel: inputs mapped to zero

Image: reachable outputs

Injectivity

Surjectivity

Subspace

Hinglish (regional understanding)

Intuition Hinglish mein samjho

Dekho, ek linear transformation basically ek "honest machine" hai jo vectors ko vectors mein badalta hai, lekin do rule follow karta hai: agar tum pehle do vectors ko add karke daalo, toh wahi answer aata hai jo alag-alag daal ke add karne pe aata; aur agar vector ko double karo toh output bhi double. In dono rules ka ek seedha consequence — zero hamesha zero pe jaata hai, T(0)=0T(0)=0. Isiliye Ax+bAx+b wale affine maps linear nahi hote jab b0b\neq0.

Ab do sabse important cheezein. Kernel matlab woh saare input vectors jo machine 0 bana deti hai — yeh domain VV ke andar rehta hai, WW mein nahi (yeh sabse common galti hai!). Agar kernel mein sirf 00 hai, toh map injective hai (koi do alag inputs same output nahi dete). Image matlab woh saare outputs jo machine bana sakti hai — yeh WW ke andar rehta hai, aur matrix ke case mein yeh column space hota hai.

In dono ko jodne wala magic formula hai Rank–Nullity: dimV=nullity+rank\dim V = \text{nullity} + \text{rank}, yaani jitne dimensions crush hue (kernel) plus jitne reachable hain (image), total input dimension ke barabar. Humare example T(x,y,z)=(x+y+z,xz)T(x,y,z)=(x+y+z,\,x-z) mein nullity 11, rank 22, aur 1+2=31+2=3 — perfect. Yaad rakhne ke liye: "KILL goes IN, REACH comes OUT" — kernel input ko maarta hai, image output deta hai. Yeh idea poore linear algebra ki backbone hai, eigenvalues se lekar solving systems tak.

Go deeper — visual, from zero

Test yourself — Linear Algebra (Full)

Connections