4.5.44 · D2Linear Algebra (Full)

Visual walkthrough — Subspaces — four fundamental subspaces of a matrix

1,659 words8 min readBack to topic

Step 0 — What is a "vector" and what is ""? (nothing assumed)

Our matrix takes an input arrow and produces an output arrow. The rule is combine the columns:

  • = how much of the first column arrow you take.
  • = how much of the second column arrow you take.
  • The output is the tip of the two scaled arrows placed head-to-tail.

WHY read this way? Because it turns an abstract "matrix times vector" into a picture of mixing two fixed arrows. That single idea generates every subspace below.

Figure — Subspaces — four fundamental subspaces of a matrix

Step 1 — Draw the two columns and look at them

WHAT we do: plot and .

WHY: the output of the machine is always a mix of these two, so the set of reachable outputs is decided entirely by what these two arrows point at.

PICTURE: notice — column 2 is column 1 stretched by 2. They lie on the same line. So mixing them never escapes that line. The blue line is the whole column space: a 1-dimensional line through the origin, not the full plane.

Figure — Subspaces — four fundamental subspaces of a matrix

Step 2 — Which outputs are FORBIDDEN? (the red zone)

WHAT: ask "can the output ever leave the blue line?" No. Any off the blue line can never be written as .

WHY it matters: this is exactly the statement "$Ax=b$ is solvable ". A target off the line has no recipe.

PICTURE: the plane splits into two coloured regions — the blue line of reachable outputs, and everything else (drawn red) that is unreachable. The output space is carved in two.

Figure — Subspaces — four fundamental subspaces of a matrix

Step 3 — Which inputs get CRUSHED to zero? (the null space)

WHAT we do: solve . Since both rows are (row 2 row 1), we need only:

Pick : the special solution is .

WHY: one equation in two unknowns leaves one free variable, so — a line of crushed inputs. See Rank–Nullity Theorem.

PICTURE (in the input space): the green line through . Every arrow on it, fed into the machine, comes out as the zero arrow.

Figure — Subspaces — four fundamental subspaces of a matrix

Quick check of the crush:


Step 4 — The rows, and why they are perpendicular to the crush

WHAT we do: draw the row arrow (orange) in the same input plane as the green null line.

WHY the tool "dot product": means each row dotted with is zero. The dot product answers exactly one question — "are these two arrows perpendicular?" — because it equals zero precisely when they meet at . That is why dotting, not any other operation, exposes the geometry here.

PICTURE: orange row line and green null line cross at a perfect right angle. This is made visible. See Orthogonal Complements.

Figure — Subspaces — four fundamental subspaces of a matrix

Step 5 — The fourth subspace: forbidden outputs, found by transposing

WHAT we do: solve . Columns of are the rows of ; both are multiples of , giving one equation:

WHY: this direction is perpendicular to every column, so it is perpendicular to the whole blue column line. It names the red forbidden zone: outputs pile up along blue, and the direction you can never reach is exactly this red arrow.

PICTURE (in the output space): blue column line and red left-null line cross at . , and .

Figure — Subspaces — four fundamental subspaces of a matrix

Orthogonality check (column left-null):


Step 6 — Edge case: the full-rank machine (nothing is crushed)

WHAT: swap to , whose columns point in different directions.

WHY show this: to prove the pictures above were a special (rank-deficient) case. When columns are independent, the story changes shape and you must not carry over old intuitions.

PICTURE: the two blue columns now span the whole plane. Nothing is forbidden (, red zone vanishes). The only input crushed to zero is the origin itself, so the green null "line" shrinks to a single point.

Figure — Subspaces — four fundamental subspaces of a matrix

The one-picture summary

Two planes side by side. Left = input space : orange row line and green null line at , filling it. Right = output space : blue column line and red left-null line at , filling it. The machine arrows across the middle, sending green origin (crush) and everything else blue line.

Figure — Subspaces — four fundamental subspaces of a matrix
Recall Feynman: retell the whole walkthrough

I drew the machine's two columns and noticed they lay on one line — so the outputs it can make (blue) form just a line, and everything off that line (red) is forbidden juice. Then I asked which inputs the machine flattens: solving gave a green line of "wasted recipes". I drew the machine's rows (orange) in the same input plane and dotted a row with a null vector — it came out zero, meaning orange and green cross at a right angle and together fill the input plane. Transposing gave the last piece: a red direction perpendicular to the blue outputs, naming exactly the forbidden zone. Finally I swapped in a matrix whose columns spread apart — now nothing is forbidden and nothing is crushed, showing the earlier squeeze was the special rank-1 case. Two lines in, two lines out, each pair at perfect right angles.


Recall

What does reading as let you see?
The output is a mixture of the fixed column arrows, so reachable outputs = span of columns = .
In our matrix , why is only a line?
Column 2 column 1, so the two columns share one direction; rank .
Why does dotting a row with expose the geometry of ?
, and a dot product is zero exactly when the arrows are perpendicular — so means every row.
What happens to the null space when is full rank ()?
It collapses to the single point ; nothing is crushed.
Which subspace names the "forbidden output" direction in ?
The left null space , perpendicular to the column space.

Connections

  • Rank of a Matrix — the one number that fixed every dimension in these pictures.
  • Rank–Nullity Theorem — the green line's dimension came straight from here.
  • Orthogonal Complements — the right angles in Steps 4 and 5.
  • Solving Ax=b — Step 2's red forbidden zone is exactly the unsolvable targets.
  • RREF and Pivots — how we found the pivot/free split behind the drawings.
  • Least Squares & Projections — what to do when your target lands in the red zone.