4.5.29Linear Algebra (Full)

Eigenvalues and eigenvectors — characteristic polynomial

1,730 words8 min readdifficulty · medium1 backlinks

WHAT are we defining?


WHY does det(AλI)=0\det(A-\lambda I)=0 find the eigenvalues? (Derivation from scratch)

We don't memorise — we build it.

Step 1 — Rewrite the defining equation. Ax=λxAxλx=0.A\mathbf{x} = \lambda\mathbf{x} \quad\Longleftrightarrow\quad A\mathbf{x}-\lambda\mathbf{x}=\mathbf{0}. Why this step? We want everything on one side so we can factor out x\mathbf{x}.

Step 2 — Factor out x\mathbf{x} using the identity. We can't write (Aλ)x(A-\lambda)\mathbf{x} because AA is a matrix and λ\lambda is a scalar — they live in different worlds. Insert the identity: λx=λIx\lambda\mathbf{x}=\lambda I\mathbf{x}. Then (AλI)x=0. (A-\lambda I)\mathbf{x}=\mathbf{0}. Why this step? Now AλIA-\lambda I is a genuine matrix, so this is an ordinary homogeneous linear system.

Step 3 — Demand a nonzero solution. A homogeneous system Mx=0M\mathbf{x}=\mathbf{0} has a nonzero solution iff MM is singular (not invertible). If M=(AλI)M=(A-\lambda I) were invertible, multiplying by M1M^{-1} would force x=0\mathbf{x}=\mathbf{0}, which we forbade. Why this step? The whole point is x0\mathbf{x}\neq\mathbf0, and singularity is the gateway condition.

Step 4 — Singular \Leftrightarrow zero determinant. det(AλI)=0.\boxed{\det(A-\lambda I)=0.} Why this step? "Not invertible" and "determinant =0=0" are the same statement. This is a polynomial equation in λ\lambda — solvable!


Two structural facts (derived, not memorised)

For a 2×22\times2 matrix A=(abcd)A=\begin{pmatrix}a&b\\c&d\end{pmatrix}: p(λ)=det(aλbcdλ)=(aλ)(dλ)bc.p(\lambda)=\det\begin{pmatrix}a-\lambda&b\\c&d-\lambda\end{pmatrix}=(a-\lambda)(d-\lambda)-bc. Expand: p(λ)=λ2(a+d)λ+(adbc)=λ2tr(A)λ+det(A).p(\lambda)=\lambda^2-(a+d)\lambda+(ad-bc)=\lambda^2-\operatorname{tr}(A)\,\lambda+\det(A).


Worked Example 1 — a clean 2×22\times2

Let A=(2112)A=\begin{pmatrix}2&1\\1&2\end{pmatrix}.

Characteristic polynomial: p(λ)=(2λ)21.p(\lambda)=(2-\lambda)^2-1. Why this step? Direct (aλ)(dλ)bc(a-\lambda)(d-\lambda)-bc with a=d=2, bc=1a=d=2,\ bc=1.

p(λ)=λ24λ+3=(λ1)(λ3).p(\lambda)=\lambda^2-4\lambda+3=(\lambda-1)(\lambda-3). So λ1=1, λ2=3\lambda_1=1,\ \lambda_2=3.

Check: tr=4=1+3\operatorname{tr}=4=1+3 ✓, det=3=13\det=3=1\cdot3 ✓.

Eigenvector for λ=3\lambda=3: solve (A3I)x=0(A-3I)\mathbf x=0: (1111)x=0  x1=x2  x=(11).\begin{pmatrix}-1&1\\1&-1\end{pmatrix}\mathbf x=0\ \Rightarrow\ x_1=x_2\ \Rightarrow\ \mathbf x=\begin{pmatrix}1\\1\end{pmatrix}. Why this step? Both rows give x1+x2=0-x_1+x_2=0; one free direction remains.

Eigenvector for λ=1\lambda=1: (1111)x=0x1=x2x=(11)\begin{pmatrix}1&1\\1&1\end{pmatrix}\mathbf x=0\Rightarrow x_1=-x_2\Rightarrow \mathbf x=\begin{pmatrix}1\\-1\end{pmatrix}.


Worked Example 2 — a triangular matrix (the shortcut)

Let A=(5702)A=\begin{pmatrix}5&7\\0&-2\end{pmatrix}.

p(λ)=det(5λ702λ)=(5λ)(2λ)0.p(\lambda)=\det\begin{pmatrix}5-\lambda&7\\0&-2-\lambda\end{pmatrix}=(5-\lambda)(-2-\lambda)-0. Why this step? The lower-left entry is 00, so the determinant of a triangular matrix is just the product of diagonal entries.

Roots: λ=5, λ=2\lambda=5,\ \lambda=-2exactly the diagonal entries.


Worked Example 3 — repeated root (algebraic vs geometric)

Let A=(3103)A=\begin{pmatrix}3&1\\0&3\end{pmatrix}. p(λ)=(3λ)2λ=3 (twice).p(\lambda)=(3-\lambda)^2 \Rightarrow \lambda=3 \text{ (twice)}. The root 33 has algebraic multiplicity 2. Eigenvectors: (A3I)=(0100)(A-3I)=\begin{pmatrix}0&1\\0&0\end{pmatrix}, so x2=0x_2=0, giving only x=(10)\mathbf x=\binom{1}{0} — a single independent eigenvector (geometric multiplicity 1).


Common mistakes (Steel-manned)


Active recall

Recall Test yourself (hide answers)
  • Q: Why must we insert II to get (AλI)(A-\lambda I)? → Because λ\lambda is a scalar; AλA-\lambda is undefined, but AλIA-\lambda I is a matrix.
  • Q: What condition makes (AλI)x=0(A-\lambda I)\mathbf x=0 have a nonzero solution? → AλIA-\lambda I singular, i.e. det(AλI)=0\det(A-\lambda I)=0.
  • Q: For 2×22\times2, what equals tr(A)\operatorname{tr}(A) and what equals det(A)\det(A)? → Sum and product of eigenvalues.
  • Q: Eigenvalues of a triangular matrix? → Its diagonal entries.
Recall Feynman: explain to a 12-year-old

Imagine pushing a toy car in different directions. Usually the wall (the matrix) bounces it off at a new angle. But there are a few magic directions where the wall just makes the car go faster or slower along the same straight line, never turning it. Those magic straight lines are eigenvectors, and "how much faster/slower" is the eigenvalue. The characteristic polynomial is a treasure-map equation: solve it and out pop the magic speed-numbers.


Flashcards

What is an eigenvector of AA?
A nonzero vector x\mathbf x with Ax=λxA\mathbf x=\lambda\mathbf x for some scalar λ\lambda.
Definition of the characteristic polynomial
p(λ)=det(AλI)p(\lambda)=\det(A-\lambda I).
Why does det(AλI)=0\det(A-\lambda I)=0 give eigenvalues?
(AλI)x=0(A-\lambda I)\mathbf x=0 has a nonzero solution iff AλIA-\lambda I is singular iff its determinant is 00.
Degree of the characteristic polynomial of an n×nn\times n matrix
nn.
Sum of eigenvalues equals
tr(A)\operatorname{tr}(A) (trace).
Product of eigenvalues equals
det(A)\det(A).
Eigenvalues of a triangular matrix
The diagonal entries.
Algebraic vs geometric multiplicity relation
11 \le geometric \le algebraic for each eigenvalue.
A matrix is defective when
geometric multiplicity << algebraic multiplicity (not diagonalizable).
2×2 characteristic polynomial in trace/det form
λ2tr(A)λ+det(A)\lambda^2-\operatorname{tr}(A)\lambda+\det(A).

Connections

  • Determinants — the singularity test that powers the whole method.
  • Null Space and Rank — eigenvectors live in ker(AλI)\ker(A-\lambda I).
  • Diagonalization — when independent eigenvectors fill space, A=PDP1A=PDP^{-1}.
  • Trace of a Matrix — sum-of-eigenvalues sanity check.
  • Complex Numbers — roots may be complex even for real AA.
  • Cayley–Hamilton TheoremAA satisfies its own characteristic polynomial.

Concept Map

satisfies

lambda is

rewrite

nonzero solution needs

singular iff

defines

roots are

plug back to solve

degree n for n by n

2x2 case gives

sum of roots

product of roots

Eigenvector x nonzero

Ax equals lambda x

Eigenvalue lambda

A minus lambda I times x equals 0

A minus lambda I singular

det of A minus lambda I equals 0

Characteristic polynomial p of lambda

Degree n polynomial

lambda^2 minus tr A lambda plus det A

trace A

det A

Hinglish (regional understanding)

Intuition Hinglish mein samjho

Dekho, ek matrix AA basically vectors ko ghumata bhi hai aur stretch bhi karta hai. Lekin kuch special directions hote hain jahan matrix sirf stretch karta hai, ghumata bilkul nahi — woh special direction ko hum eigenvector bolte hain, aur jitna stretch hota hai woh number eigenvalue λ\lambda hai. Equation simple hai: Ax=λxA\mathbf{x}=\lambda\mathbf{x}, yaani AA lagane ke baad bhi vector apni hi line pe rehta hai.

Ab eigenvalue nikalte kaise hain? Ax=λxA\mathbf{x}=\lambda\mathbf{x} ko (AλI)x=0(A-\lambda I)\mathbf{x}=0 banao. Yaad rakho, λ\lambda scalar hai isliye II (identity) daalna zaroori hai, warna AλA-\lambda ka koi matlab nahi banta. Ab yeh ek homogeneous system hai, aur iska non-zero solution tabhi milega jab matrix (AλI)(A-\lambda I) singular ho — matlab uska determinant zero ho. Bas yahi se characteristic polynomial aata hai: det(AλI)=0\det(A-\lambda I)=0. Iski roots hi eigenvalues hain.

Ek mast shortcut: 2×22\times2 ke liye polynomial λ2traceλ+det\lambda^2 - \text{trace}\cdot\lambda + \det banta hai. Toh eigenvalues ka sum = trace aur product = determinant — yeh check har baar lagao, galti pakdi jayegi. Aur agar matrix triangular ya diagonal hai, toh eigenvalues seedhe diagonal pe baithe hote hain, alag se mehnat hi nahi.

Common galti: eigenvalue nikalne ke baad eigenvector ke liye phir se determinant mat lagao — eigenvector ke liye system (AλI)x=0(A-\lambda I)\mathbf{x}=0 solve karo, null space hi answer deta hai. Aur dhyaan rakho real matrix ke bhi complex eigenvalues ho sakte hain (rotation matrix ke ±i\pm i aate hain). Yeh poora concept aage diagonalization aur Cayley-Hamilton mein kaam aata hai, toh strong rakho.

Go deeper — visual, from zero

Test yourself — Linear Algebra (Full)

Connections