4.5.31Linear Algebra (Full)

Diagonalization — conditions, procedure

2,017 words9 min readdifficulty · medium6 backlinks

What does "diagonalizable" actually mean?

WHAT is PP? WHAT is DD? This is the heart of it. Let's derive what they must be.


The condition for diagonalizability

WHY this exact condition? Because PP must be invertible, and an n×nn\times n matrix is invertible     \iff its columns are linearly independent. The columns are eigenvectors. So we need nn independent eigenvectors. No spanning set \Rightarrow no invertible PP \Rightarrow no diagonalization.

Two useful sufficient/necessary refinements

Figure — Diagonalization — conditions, procedure

The procedure (step by step)


Worked Example 1 — distinct eigenvalues

Let A=(4123)A=\begin{pmatrix} 4 & 1 \\ 2 & 3\end{pmatrix}.

Step 1 — characteristic equation. det(AλI)=det(4λ123λ)=(4λ)(3λ)2=λ27λ+10=(λ5)(λ2).\det(A-\lambda I)=\det\begin{pmatrix}4-\lambda & 1\\ 2 & 3-\lambda\end{pmatrix}=(4-\lambda)(3-\lambda)-2 = \lambda^2-7\lambda+10=(\lambda-5)(\lambda-2). Why this step? Eigenvalues are where AλIA-\lambda I becomes singular (has a nonzero null vector). λ1=5, λ2=2\lambda_1=5,\ \lambda_2=2 — two distinct values, so already guaranteed diagonalizable.

Step 2 — eigenvectors. For λ=5\lambda=5: A5I=(1122)A-5I=\begin{pmatrix}-1 & 1\\ 2 & -2\end{pmatrix}. Row reduce: x1+x2=0x1=x2-x_1+x_2=0\Rightarrow x_1=x_2. Eigenvector p1=(11)\mathbf{p}_1=\begin{pmatrix}1\\1\end{pmatrix}. For λ=2\lambda=2: A2I=(2121)2x1+x2=0x2=2x1A-2I=\begin{pmatrix}2&1\\2&1\end{pmatrix}\Rightarrow 2x_1+x_2=0\Rightarrow x_2=-2x_1. Eigenvector p2=(12)\mathbf{p}_2=\begin{pmatrix}1\\-2\end{pmatrix}. Why this step? Each eigenvector spans the null space of AλIA-\lambda I; it's the direction that only gets stretched.

Step 3–5 — assemble. P=(1112),D=(5002).P=\begin{pmatrix}1 & 1\\ 1 & -2\end{pmatrix},\quad D=\begin{pmatrix}5 & 0\\ 0 & 2\end{pmatrix}. Why this step? Column 1 (λ=5\lambda=5 vector) pairs with D11=5D_{11}=5; column 2 with D22=2D_{22}=2 — same order.

Check: detP=30\det P = -3 \ne 0, so PP is invertible. ✓ And one can verify AP=PDAP=PD.


Worked Example 2 — repeated eigenvalue, NOT diagonalizable

Let A=(2102)A=\begin{pmatrix}2 & 1\\ 0 & 2\end{pmatrix} (a shear).

Step 1: det(AλI)=(2λ)2=0λ=2\det(A-\lambda I)=(2-\lambda)^2=0\Rightarrow \lambda=2, algebraic multiplicity a=2a=2.

Step 2: A2I=(0100)A-2I=\begin{pmatrix}0&1\\0&0\end{pmatrix}. Solve (0100)x=0x2=0\begin{pmatrix}0&1\\0&0\end{pmatrix}\mathbf{x}=0\Rightarrow x_2=0, x1x_1 free. Only one independent eigenvector (10)\begin{pmatrix}1\\0\end{pmatrix}, so geometric multiplicity g=1g=1.

Step 3: g(2)=1<a(2)=2g(2)=1 < a(2)=2. We have only 1 eigenvector for a 2×22\times2 matrix → cannot build invertible PP → NOT diagonalizable.

Why this matters: This is the prototype "defective" matrix. A shear has a single fixed direction; there's no second independent direction it merely stretches, so no diagonalizing basis exists.


Worked Example 3 — repeated eigenvalue that IS diagonalizable

Let A=(3003)=3IA=\begin{pmatrix}3 & 0\\ 0 & 3\end{pmatrix}=3I.

det(AλI)=(3λ)2\det(A-\lambda I)=(3-\lambda)^2, so λ=3\lambda=3 with a=2a=2. Now A3I=0A-3I=0, whose null space is all of R2\mathbb{R}^2, so g=2g=2. Since g=ag=a, it's diagonalizable — indeed it's already diagonal. Lesson: repeated eigenvalues are fine as long as they supply enough independent eigenvectors.


Recall Feynman: explain to a 12-year-old

Imagine a stretchy rubber sheet with a picture on it. A matrix is a machine that pulls and twists the sheet. Most directions get twisted around — confusing. But some special arrows (eigenvectors) only get longer or shorter, never turned. "Diagonalizing" means redrawing your graph paper along those special arrows. In that new graph paper the machine just stretches each axis by a number (the eigenvalue) — no twisting at all. If you can find enough special arrows to fill the whole space, you win. If the machine only has too few special arrows (like a pure shear/skew), you can't, and we say it's "not diagonalizable."


Common mistakes (Steel-man)


Active recall

What is the defining equation of a diagonalizable matrix?
A=PDP1A = PDP^{-1} with PP invertible and DD diagonal.
What MUST the columns of PP be?
Linearly independent eigenvectors of AA.
What are the diagonal entries of DD?
The eigenvalues, ordered to match the eigenvector columns of PP.
Exact iff-condition for diagonalizability (n×n)?
AA has nn linearly independent eigenvectors (equivalently g(λ)=a(λ)g(\lambda)=a(\lambda) for every eigenvalue).
Why does AP=PDAP = PD force columns of PP to be eigenvectors?
Column jj of both sides gives Apj=λjpjA\mathbf{p}_j = \lambda_j\mathbf{p}_j.
A quick sufficient condition for diagonalizability?
nn distinct eigenvalues.
Is the "distinct eigenvalues" condition necessary?
No — e.g. the identity has repeated eigenvalues but is diagonalizable.
Define geometric vs algebraic multiplicity.
Geometric g(λ)=dimker(AλI)g(\lambda)=\dim\ker(A-\lambda I) (independent eigenvectors); algebraic a(λ)a(\lambda) = multiplicity of λ\lambda as a root of the characteristic polynomial.
When is a matrix "defective"?
When g(λ)<a(λ)g(\lambda)<a(\lambda) for some eigenvalue → not diagonalizable.
Why is (2102)\begin{pmatrix}2&1\\0&2\end{pmatrix} not diagonalizable?
λ=2\lambda=2 has a=2a=2 but only one eigenvector (g=1g=1).
How does diagonalization speed up AkA^k?
Ak=PDkP1A^k = PD^kP^{-1}, and DkD^k raises each diagonal entry to the kk.

Connections

  • Eigenvalues and Eigenvectors — the raw ingredients.
  • Characteristic Polynomial — source of algebraic multiplicities.
  • Similar Matrices — diagonalization = similarity to a diagonal matrix.
  • Matrix Powers and Exponentials — main payoff of diagonalization.
  • Spectral Theorem — symmetric matrices are always (orthogonally) diagonalizable.
  • Jordan Normal Form — what to do when a matrix is not diagonalizable.
  • Change of BasisPP is a change-of-basis matrix into the eigenbasis.

Concept Map

similar to diagonal

columns of P

diagonal of D

from equation

from equation

requires P invertible

must span space

equivalent test

geometric mult

algebraic mult

guaranteed by

enables

Matrix A

A = PDP inverse

Eigenvectors

Eigenvalues

A p = lambda p

n independent eigenvectors

g of lambda = a of lambda

dim ker of A minus lambda I

root multiplicity of det

n distinct eigenvalues

A^100 = P D^100 P inverse

Hinglish (regional understanding)

Intuition Hinglish mein samjho

Dekho, ek matrix AA basically ek transformation hai — woh vectors ko stretch, rotate ya shear karta hai. Diagonalization ka pura idea yeh hai: kya aisi koi smart coordinate system (basis) mil sakti hai jismein yeh matrix sirf stretch kare, ghumaye-shear na kare? Agar haan, toh us basis mein matrix diagonal ban jata hai — aur diagonal matrix ke saath kaam karna bahut easy hota hai (powers, determinant sab element-wise ho jaate hain). Isi liye agar A=PDP1A=PDP^{-1} ho, toh A100=PD100P1A^{100}=PD^{100}P^{-1} — ek line ka kaam.

Ab PP aur DD kahan se aate hain? Yeh free choice nahi hai. Agar A=PDP1A=PDP^{-1} likho aur dono taraf PP se multiply karo, toh milta hai AP=PDAP=PD, aur column-by-column dekho toh Apj=λjpjA\mathbf{p}_j=\lambda_j\mathbf{p}_j — yeh toh seedha eigenvalue equation hai! Matlab PP ke columns eigenvectors hone hi chahiye, aur DD ke diagonal pe unke eigenvalues. Bas yahi hai.

Condition kya hai? n×nn\times n matrix diagonalizable tabhi hai jab uske paas nn linearly independent eigenvectors hon (kyunki PP invertible hona chahiye). Shortcut: agar saare nn eigenvalues distinct hain, toh guaranteed diagonalizable. Lekin repeated eigenvalue ho toh check karo — geometric multiplicity (gg, kitne independent eigenvectors) algebraic multiplicity (aa) ke barabar honi chahiye. Jaise shear matrix (2102)\begin{pmatrix}2&1\\0&2\end{pmatrix} mein a=2a=2 par g=1g=1, isliye woh "defective" hai aur diagonalize nahi hoti.

Procedure simple hai: (1) characteristic equation se eigenvalues nikalo, (2) har eigenvalue ke eigenvectors nikalo, (3) ginlo — nn aaye toh aage badho, (4) PP mein eigenvectors columns, (5) DD mein same order ke eigenvalues. Sabse common galti: PP aur DD ka order match nahi karna — column ka eigenvector aur diagonal ka eigenvalue same pair ke hone chahiye!

Go deeper — visual, from zero

Test yourself — Linear Algebra (Full)

Connections