4.5.25 · D1Linear Algebra (Full)

Foundations — Invertible matrix theorem — 12+ equivalent conditions

1,976 words9 min readBack to topic

Before you can read the parent theorem, you must own every piece of notation it fires at you. We build each one from nothing — plain words, then a picture, then the reason the theorem needs it. Nothing is used before it is earned.


1. A vector — the arrow we push around

  • Plain words: a location, or equivalently a "push" of a certain length and direction.
  • Picture: an arrow from the origin. Look at figure s01 — the black arrow is the vector .
  • Why the topic needs it: the whole theorem is about the equation . Both and are vectors. If you can't see them as arrows, you can't see what the matrix does to them.
Figure — Invertible matrix theorem — 12+ equivalent conditions

The symbol (read "R-n") just names the whole space of all such arrows with numbers. is the flat plane; is 3D space.

The special arrow (bold zero) is the vector all of whose numbers are — an arrow of zero length, sitting exactly at the origin, pointing nowhere.


2. A matrix — the machine

  • Plain words: a rulebook that takes an arrow in and spits a new arrow out.
  • Picture: think of it as a transformation of the whole plane — it grabs every arrow and moves its tip somewhere new. See Linear Transformations — Injective and Surjective.
  • Why the topic needs it: is the star of the show. "Is invertible?" is the entire question.

Square matters. A grid that is (3 rows, 5 columns) takes 5-number arrows in and gives 3-number arrows out — the input and output live in different spaces, so it can never "undo" cleanly. The theorem only applies when input space = output space, i.e. when is square.


3. Matrix times vector — how the machine runs

This is the single most important motion in the whole subject, so we picture it two ways.

  • Plain words: the output is a weighted sum of the columns. The number says "how much of column 1," says "how much of column 2," and so on. See Linear Independence and Span.
  • Why this view and not the dry row-by-row dot product? Because the theorem is about the columns — whether they're independent, whether they span. Writing as a column combination makes the equation literally say: "can I mix the columns to build ?" That single reframing powers half the theorem.
  • Picture: figure s02 stretches column arrows by the weights and adds them tip-to-tail. The red arrow is the result .
Figure — Invertible matrix theorem — 12+ equivalent conditions

4. The identity and the inverse

  • Plain words: run , then run , and you're back where you started — total information preserved.
  • Why the topic needs it: condition 1 of the theorem is " exists." Every other condition is a cheaper test for this exact thing.

5. The equation — the "does it squash?" test

This is the heartbeat of the theorem. Every arrow that the machine crushes down to the zero arrow is a witness that information was lost.

  • Picture: figure s03 shows a good machine (only the origin maps to the origin) versus a bad one (a whole red line of arrows all collapse onto the origin).
  • Why the topic needs it: if even one nonzero arrow gets crushed, two different inputs ( and ) share the output — the machine is not undoable. That's condition 4, and it drives conditions 5, 6, 14, 17.
Figure — Invertible matrix theorem — 12+ equivalent conditions

The set of all arrows that crushes to has a name: the null space, written . See Rank and Nullity. A good (invertible) machine has only the zero arrow gets crushed.


6. The determinant — the area-scaling number

  • Plain words: feed the machine a unit square; is the (signed) area of the parallelogram that comes out.
  • Picture: the unit square becomes a squashed parallelogram. If the machine flattens the square onto a line, that parallelogram has zero area. See Determinant.
  • Why the topic needs it: exactly means the machine flattened space onto something lower-dimensional — it lost a whole dimension of information. That is condition 13, and it is often the cheapest test to run.

A flattened square = crushed arrows = non-trivial null space. Zero determinant and squashing are the same event seen from different windows — that's the theorem in miniature.


7. Rank, span, independence, basis, eigenvalue — the supporting cast

Quick plain-words definitions so the theorem's vocabulary is complete:

  • Why the topic needs them: conditions 5, 8, 15, 16, 14 are each phrased in exactly this language. "Full rank " means no dimension was lost — the same good-machine idea one more time.

8. Elementary row operations — how we test cheaply

  • Plain words: tidy the grid step by step without changing which arrows it crushes.
  • Why the topic needs it: repeatedly tidying either arrives at the identity (good machine) or gets stuck with a row of zeros (crushed dimension). That's conditions 2 and 3.

How these feed the theorem

Vector = arrow in Rn

Matrix times vector

Matrix = machine

Equation Ax = 0

Columns span and independence

Null space Nul A

Rank

Determinant

Row operations to identity

Eigenvalues

Identity I and inverse

Invertible Matrix Theorem

Every arrow into the box "Invertible Matrix Theorem" is one equivalent condition — and they all trace back to the same root idea: does the machine crush any arrow?


Equipment checklist

Test yourself — cover the right side and answer before revealing.

What is a vector, in one picture?
An arrow from the origin to the point given by its list of numbers.
What does mean?
The space of all arrows made of numbers.
When is a matrix "square", and why must the IMT matrices be square?
Equal rows and columns; only then do input and output live in the same space so an undo can exist.
Write as a combination of columns.
.
What does the identity matrix do to any arrow?
Nothing — .
Define by its property.
The matrix with ; the undo-machine.
What is a non-trivial solution of ?
A nonzero arrow that still crushes to .
What is the null space ?
The set of all arrows sends to .
What does mean geometrically?
The machine flattens area/volume to zero — it squashed a whole dimension.
What is the rank of ?
The number of independent directions surviving in the output.
Why does eigenvalue signal non-invertibility?
for a nonzero — a crushed arrow, so the null space is nonzero.