4.5.13 · D1Linear Algebra (Full)

Foundations — Null space (kernel) and column space (image) — basis, dimension

2,047 words9 min readBack to topic

Before you can read the parent note, you need to own every symbol it uses. This page builds each one from nothing, in the order they depend on each other. Nothing here assumes you have seen linear algebra before.


1. A vector — the thing everything is made of

Figure — Null space (kernel) and column space (image) — basis, dimension

We need vectors because the matrix machine takes a vector in and gives a vector out. No vectors, no machine.

Two things you can do to vectors — and these two operations are the entire game:

Why only these two? Because "linear" literally means "built only from scaling and adding." Every idea in this topic is one of these two moves wearing a costume.


2. — the room the vectors live in


3. A matrix and its shape

Why do we care that each column is a vector in ? Because — you'll see in a moment — the outputs of the machine are always combinations of those columns. The columns are the machine's whole "stock of ingredients."


4. The product — the machine in action

Notice is an output vector, and it is always some combination of the columns. That single fact is the seed of the column space.


5. Linear combination and span — the reachable set

The word zero vector also enters here: it is the list of all zeros. Every span passes through it (weight all zeros), which is why the null space (inputs sent to ) is never empty — it always at least contains .


6. Linear independence, basis, dimension — measuring the room


7. Pivots, rank, and RREF — the machine for finding bases


Prerequisite map

Vectors: lists and arrows

R to the n: input and output rooms

Linear combination

Matrix A as columns side by side

Product Ax as a mix of columns

Span equals reachable outputs

Linear independence

Basis

Dimension

Row reduction and RREF

Pivots free columns rank

Null space and Column space

Everything upstream must be solid before the parent topic makes sense. Downstream from the topic sit Rank–Nullity Theorem, Injective and surjective linear maps, Solving Ax=b, and the Four fundamental subspaces.


Equipment checklist

Cover the right side and test yourself. If any answer is fuzzy, re-read that section above.

What is a vector, in plain words?
An ordered list of numbers, pictured as an arrow from the origin to that point.
What do and the superscript mean?
All lists of real numbers; is how many components / the dimension of the room.
For , which is rows and which is columns?
= number of rows (output size), = number of columns (input size).
Why can a matrix be read as columns standing side by side?
Because mixes those columns; each column is an ingredient vector in .
What is , honestly?
A weighted sum of 's columns, weights = components of : .
What is a linear combination?
Any sum of scaled vectors added together.
What is the span of some vectors?
The set of ALL their linear combinations — the reachable line/plane/space.
When are vectors linearly independent?
When none is a combination of the others; only all-zero weights reach .
What is a basis?
A minimal set that both spans the space and is independent.
What is dimension?
The number of vectors in any basis of the space.
What is a pivot, and what is the rank?
A leading 1 in RREF; rank = number of pivots = independent columns.
What does RREF preserve and change?
Preserves the solution set of (null space) and which columns are independent; changes the actual column entries.

Connections

  • Linear independence and basis — the ideas of §5–§6 in full.
  • Rank of a matrix — rank is the pivot count of §7.
  • Row reduction & RREF — the engine of §7.
  • Rank–Nullity Theorem — the counting identity the topic builds toward.
  • Injective and surjective linear maps — trivial null space ⇔ injective.
  • Solving Ax=b — solvable iff is in the span (column space).
  • Four fundamental subspaces — where Col and Null sit among all four.