4.5.29 · D1Linear Algebra (Full)

Foundations — Eigenvalues and eigenvectors — characteristic polynomial

1,917 words9 min readBack to topic

Before you can read the parent note, you need to already own a small toolbox of symbols. Below is every symbol and idea the parent uses, built from absolute zero, in an order where each one leans only on the ones before it.


1. The arrow: what a vector is

Figure — Eigenvalues and eigenvectors — characteristic polynomial

Look at the figure: the red arrow starts at the origin (the point ) and its tip lands at the point . The two black dashed legs show the "right" amount and the "up" amount .

The special arrow with all zeros, , is called the zero vector — it has no length and points nowhere. Remember it: the parent note forbids it as an eigenvector, and we'll see why.


2. The machine: what a matrix is

Multiplying by a vector produces a new vector , computed row-by-row:

Figure — Eigenvalues and eigenvectors — characteristic polynomial

In the figure, the black arrow is the input ; the red arrow is the output . Notice it points in a different direction — the machine turned it. An eigenvector is the special input where black and red lie on the same line.


3. The stretch number: what a scalar is

What does each kind of look like?

  • : arrow twice as long, same direction.
  • : arrow half as long, same direction.
  • : same length, flipped to point the opposite way.
  • : collapses to the zero vector.
Figure — Eigenvalues and eigenvectors — characteristic polynomial

The figure shows one black arrow scaled by , by , and by — all three copies stay on the same dashed line through the origin. Staying on that line is the visual meaning of "only stretched, never turned," which is what demands.


4. The "do-nothing" machine: the identity matrix

Why does the parent note suddenly slip an into ? Because you cannot subtract a plain number from a matrix: the expression "" is meaningless — a grid minus a single number has no defined rule. But scaling the identity, , is a genuine matrix: Now is a legal grid-minus-grid subtraction. That is the only reason appears.


5. The volume dial: the determinant

Why does the topic care about the determinant being zero? A zero area means the parallelogram has been squashed flat onto a line — the machine has crushed 2D down to 1D. When that happens the machine is singular: it destroys information and cannot be undone. See Determinants for the full story.

Figure — Eigenvalues and eigenvectors — characteristic polynomial

Left: a normal matrix — its two column arrows (black) span a red parallelogram with real area. Right: a singular matrix — the columns are lined up, the red parallelogram is flattened to a segment, area .


6. Sending an arrow to nothing: the null space and singular matrices

The parent's Step 3 says: " has a nonzero solution iff is singular." Here is why in plain words:

  • If could be undone (invertible), then applying the undo-machine to both sides of gives — the only solution is the boring zero arrow.
  • So a nonzero solution can exist only when cannot be undone — i.e. is singular — i.e. .

That chain, "nonzero solution singular determinant zero," is the engine that turns the eigen-equation into a solvable polynomial. More at Null Space and Rank.


7. The treasure map: what a polynomial and its roots are

For a matrix, turns out to be a degree-2 polynomial (its highest power is ); for it has degree . Its roots are the eigenvalues. So the whole hunt reduces to a school-algebra task: find the roots of a polynomial.


8. The diagonal sum: the trace

It matters because it equals the sum of the eigenvalues — a one-line check on every answer.


9. When arrows won't cooperate: complex numbers

Why the topic needs them: some real matrices (like a rotation) turn every arrow, so no real arrow ever stays on its own line. Then the characteristic polynomial, e.g. , has no real roots — but it does have the complex roots . Allowing complex guarantees the treasure map always has treasure.


The prerequisite map

Vector - an arrow

Matrix - a machine on arrows

Scalar lambda - a stretch number

Eigen-equation Ax = lambda x

Identity matrix I

A minus lambda I

Determinant - signed area

Singular means det = 0

Null space - arrows sent to zero

Characteristic polynomial

Polynomial and roots

Trace and Vieta check

Complex numbers

Eigenvalues and eigenvectors

Read it top-down: arrows and machines feed the eigen-equation; the identity lets us form ; determinant and null space explain when it's singular; polynomials, trace and complex numbers complete the algebra — and everything pours into the topic.


Equipment checklist

Hide the right side and test yourself. You are ready for the parent note when every line feels obvious.

What does the bold symbol mean, and what does it look like?
A vector — an arrow from the origin to the point , stored as a stack of numbers.
What is the zero vector and why is it banned as an eigenvector?
The arrow of length zero; if allowed, every would trivially "work" and the idea would be useless.
What does a matrix do to a vector?
It moves it to a new arrow , generally turning and stretching it.
What is a scalar and what does multiplying by it look like?
A single number; it stretches (or flips/collapses) the arrow while keeping it on the same line.
Why must we write instead of ?
You cannot subtract a plain number from a grid; is a matrix, so is a legal subtraction.
What is and what does it measure?
; the signed area of the parallelogram spanned by the columns.
What does mean geometrically?
The machine squashes space flat, so some nonzero arrow gets crushed to is singular.
What is the null space of ?
The set of all arrows with .
Why does a nonzero solution of require singular?
If were invertible, would force ; nonzero solutions need non-invertibility.
What is a root of a polynomial?
A value that makes the polynomial equal zero.
Vieta for ?
Root sum , root product .
What is ?
The sum of the diagonal entries .
Why might a real matrix need complex eigenvalues?
A rotation turns every real arrow, so the characteristic polynomial can have only complex roots like .