4.5.30 · D1Linear Algebra (Full)

Foundations — Finding eigenspaces

3,704 words17 min readBack to topic

Before you can hunt for those special arrows, you need to be fluent in the alphabet the parent note speaks. Below is every symbol and idea it leans on, built from absolute zero, each one earning its place before the next arrives.


1. Vectors — arrows with a tail at the origin

The bold letter means "the whole arrow", not a single number. The plain numbers and inside are its components — how far right and how far up the arrow reaches.

Why do we need arrows at all? Because everything the parent note does — stretching, rotating, staying-on-a-line — is a statement about directions and lengths, and an arrow is the cleanest picture of a direction with a length.

The special arrow is the zero vector: an arrow of length zero, pointing nowhere. Keep it in mind — it causes the parent note's most subtle rule (" is never an eigenvector").


2. Adding vectors — the parallelogram rule

Why introduce this now? Because later ideas — "all combinations of some arrows" (defined properly in Section 12 as span and subspace) — are literally built by stretching and adding arrows. You cannot talk about "all combinations of these arrows" until you can add them, so adding comes first.


3. Scalars and scalar multiplication — stretching an arrow

The picture is the whole story:

  • → arrow twice as long, same direction.
  • → arrow half as long, same direction.
  • → arrow flipped to point exactly backwards.
  • → arrow collapses to the origin ().

Notice: scalar multiplication never rotates the arrow (except the flip at negative , which is still on the same line). That is exactly why eigenvectors "stay on their own line."


4. Matrices — the machine that moves arrows

A matrix is not just storage — it is a function that eats a vector and produces a vector. The rule (matrix–vector multiplication) for a is:

Let's watch the machine in action on our example :

The output arrow points a different way than — the machine rotated it. Most arrows get rotated. The parent note asks: which rare arrows come out pointing the same way, only rescaled? Those are the eigenvectors.


5. Adding and subtracting matrices

This is exactly the operation hiding inside : you'll subtract one grid from another, position by position. Example:


6. The identity matrix — the "do-nothing" machine

Why do we need ? Here is the short derivation that forces it into existence. We want the non-turning condition rewritten as "some matrix times equals ", because (as Section 7 shows) that shape is the one we know how to solve.

Hence makes sense while "" does not. This is the exact same derivation the parent note performs; we reproduce it here so this page stands alone.


7. Homogeneous systems and the null space — where arrows get crushed to zero

The equation we just derived, , is a homogeneous system: a matrix times an unknown arrow equals the zero vector. ("Homogeneous" just means the right side is all zeros.)

Two arrows always live here for free: itself (every matrix sends ), and possibly a whole line or plane of others.

So the eigenspace is exactly a null space — which is why, if you know how to find a null space, you know how to find an eigenspace. For the full machinery of solving such systems, see Null space and solving homogeneous systems.


8. Row-reduction — the tool that solves these systems

To actually find a null space you need one mechanical skill: turning a matrix into a simpler, staircase shape without changing its solution set.

We will use this immediately in Section 11 to measure a matrix.


9. Determinant — the one-number test for "does this machine crush anything?"

Its meaning in pictures: is the area-scaling factor of the machine. If a machine doubles areas, . If the machine flattens 2D arrows onto a single line (area becomes ), then — the machine is called singular.


10. The characteristic polynomial — where becomes an equation in

When you actually compute , the unknown appears on the diagonal, so the determinant comes out as a polynomial in — powers of added together. Let's watch it happen for a general so the form is earned, not memorised.

Why is the degree in general? Because each of the diagonal entries contributes one factor of , and multiplying such factors gives a highest power . Full details: Characteristic polynomial.


11. Multiplicity — how many times an eigenvalue is "supposed" to appear


12. Span, subspace, basis, dimension — describing "a whole line/plane of arrows"

We promised these words back in Section 2; here they are, built from adding (Section 2) and stretching (Section 3).

Why the parent note cares: an eigenspace is not one arrow but a whole subspace of non-turning arrows. Its dimension (the geometric multiplicity, Section 11) is how the parent tells apart Example 2 (a full plane, ) from Example 3 (only a line, ). And because (Section 7), an eigenspace really is a subspace — a null space always satisfies (a), (b), (c).


13. Rank, and the Rank–Nullity theorem — sizing the eigenspace

Now that we can row-reduce (Section 8), we can measure a matrix.


14. Greek letters and shorthand you'll meet

Recall Symbol dictionary

, ::: the real numbers; the complex numbers (include ). (lambda) ::: an eigenvalue — a stretch factor. (bold) ::: a vector / arrow; bold distinguishes it from a plain number. ::: vector sum, added component by component (parallelogram tip-to-tail). ::: the zero vector, an arrow of length zero. ::: matrices (machines that move arrows). ::: a grid with rows and columns; square when . ::: matrix subtraction, entry by entry. ::: the identity matrix (do-nothing machine). ::: the eigenspace for — all its non-turning arrows plus . ::: the characteristic polynomial (degree ). ::: determinant, the area-scaling / singularity number. ::: number of independent directions the machine keeps (nonzero rows after row-reduction). ::: null space — arrows crushed to . ::: all stretch-and-add combinations of the listed arrows. ::: "belongs to / is a member of" (e.g. ).


How the foundations feed the topic

Read the map below bottom-up: follow any arrow "" as " is needed before ." Start at the top boxes (raw ideas) and trace down to the single goal box — every path you can walk is a prerequisite you now hold.

Vectors as arrows

Vector addition

Scalar multiply stretches

Span basis dimension

lambda times v is a stretched arrow

Matrix moves an arrow

A v equals lambda v

Identity matrix I

Form A minus lambda I

Matrix subtraction

Homogeneous system equals zero

Row reduction

Rank

Null space of A minus lambda I

Determinant zero means singular

Characteristic polynomial

Algebraic and geometric multiplicity

Rank Nullity theorem

Eigenspace E lambda

Finding eigenspaces

The single node at the bottom, Finding eigenspaces, is the parent topic — and it is now fully powered.


Equipment checklist

Test yourself: cover the right side and answer each before revealing.

What does a bold mean, and what is its picture?
A vector — an arrow from the origin to the point given by its components.
How do you add , and what is the picture?
Add component by component; geometrically the diagonal of the parallelogram they span (tip-to-tail).
What number world are we working over, and why note it?
The real numbers ; because over a real matrix may have no real eigenvectors (its roots may be complex).
What does do to an arrow (all cases of )?
Stretches (), shrinks (), flips (), or collapses to (); never rotates off its line.
What is the difference between a square and a rectangular matrix?
An grid is square when $