4.5.38 · D5Linear Algebra (Full)
Question bank — Symmetric matrices — spectral theorem (real eigenvalues, orthogonal eigenvectors)
Prerequisite ideas you should already own: Eigenvalues and Eigenvectors, Orthogonal Matrices, Diagonalization, Gram-Schmidt Process.
True or false — justify
Every real symmetric matrix has only real eigenvalues.
True — the proof forms the real scalar ; symmetry forces it to equal its own conjugate, so .
Every matrix with only real eigenvalues is symmetric.
False — has real eigenvalues but is not symmetric; real spectrum is necessary, not sufficient, for symmetry.
Eigenvectors of a symmetric matrix belonging to the same eigenvalue are automatically orthogonal.
False — the orthogonality proof only works when ; inside one eigenspace you must choose an orthogonal basis via Gram-Schmidt Process.
A symmetric matrix with a repeated eigenvalue can fail to be diagonalizable.
False — symmetric matrices are never defective; every eigenvalue's geometric multiplicity equals its algebraic multiplicity, so a full eigenbasis always exists.
If is built from unit-length eigenvectors of distinct eigenvalues, then .
True — orthonormal columns give , which is exactly the definition of an orthogonal matrix whose transpose is its inverse.
and are the same statement.
False — both diagonalize , but holds only for orthonormal columns; a generic from unnormalized/non-orthogonal eigenvectors has .
Any matrix satisfying has an orthonormal eigenbasis.
True — these are normal matrices; over they are unitarily diagonalizable, though a real normal matrix may need complex eigenvectors (e.g. a rotation).
The identity matrix is a valid for infinitely many different .
True — has one eigenvalue of full multiplicity, so every orthonormal basis is an eigenbasis; is completely free.
A symmetric matrix always has distinct eigenvalues.
False — nothing forbids repeats (e.g. repeats ); it guarantees a full orthonormal eigenset, not distinctness.
Spot the error
" has eigenvalue , and since is symmetric that's fine, complex eigenvalues are allowed."
The error: symmetric matrices cannot have non-real eigenvalues, so is impossible — the matrix in question is not truly symmetric.
"I diagonalized my symmetric as but , so the Spectral Theorem is wrong."
The error: you forgot to normalize the eigenvectors; unit-length orthogonal columns give , and the theorem holds once you fix the lengths.
"Eigenvectors and of aren't orthogonal, contradicting the Spectral Theorem."
The error: that matrix isn't symmetric (), so the orthogonality guarantee never applied in the first place.
"For a repeated eigenvalue I got two eigenvectors that aren't perpendicular, so my matrix must be defective."
The error: non-perpendicular basis vectors are normal inside a repeated eigenspace — apply Gram-Schmidt Process to orthogonalize them; the matrix is still fully diagonalizable.
" is a scalar, so the spectral sum is a number."
The error: is an outer product (column times row) giving an rank-1 matrix; would be the scalar .
"The trace equals the sum of diagonal entries, so it has nothing to do with eigenvalues."
The error: for any square matrix trace ; for a symmetric this lets you sanity-check computed eigenvalues instantly.
"Since is symmetric, might not be."
The error: if and is invertible, then too — inverting preserves symmetry (its eigenvalues just become ).
Why questions
Why does forming the conjugate transpose (not just the transpose) matter in the real-eigenvalue proof?
Because might a priori be complex, so is complex; stays real and positive only with conjugation, which is what forces .
Why does symmetry, specifically, produce orthogonal eigenvectors rather than merely independent ones?
The proof pivots on moving across the inner product via ; that swap is what yields , and it fails without symmetry.
Why is called orthogonal rather than just invertible?
Its columns are orthonormal, so ; geometrically it rotates/reflects without stretching, meaning changing to eigen-coordinates preserves lengths and angles.
Why does mean a symmetric matrix does "no twisting"?
Reading right to left: rotates into eigen-axes, only stretches along those axes, rotates back — a pure stretch along perpendicular directions, no shear.
Why must the eigenvectors in a rank-1 spectral piece be unit vectors?
is the orthogonal projector onto that axis only when ; otherwise the projector is scaled wrong and the pieces won't sum to .
Why does a repeated eigenvalue give an eigenspace of matching dimension for symmetric matrices but not general ones?
Symmetric (hence normal) matrices are never defective, so geometric multiplicity equals algebraic; a general matrix like a Jordan block can have algebraic multiplicity but only a -dimensional eigenspace.
Why can we relate the spectral theorem to Quadratic Forms?
A quadratic form with symmetric becomes in eigen-coordinates , so the eigenvalues are the pure stretch coefficients of the form.
Edge cases
What does the spectral theorem give for the zero matrix ?
Every eigenvalue is (), and every orthonormal basis works as ; the "stretch" collapses all directions to a single point.
Does a matrix obey the spectral theorem?
Yes trivially — it is symmetric, its single eigenvalue is , and ; it's the degenerate base case of the general statement.
What happens to orthogonality of eigenvectors when an eigenvalue is ?
Nothing changes — is a perfectly valid distinct eigenvalue, so its eigenvectors are still orthogonal to those of other eigenvalues; the matrix is just singular.
Can a symmetric matrix have negative eigenvalues, and what does that mean geometrically?
Yes — a negative means flips the sign along that eigen-axis (stretch by plus a reflection); this ties to Positive Definite Matrices failing when any .
If all eigenvalues of a symmetric matrix are equal to , what is the matrix?
It must be — the full-multiplicity eigenspace is all of , so acts as uniform scaling and can be anything orthogonal.
How does the spectral theorem specialize when is symmetric and positive definite?
All eigenvalues are strictly positive, so has an invertible square root , connecting to Positive Definite Matrices and the Singular Value Decomposition.
For a general (non-symmetric) matrix, what replaces the spectral decomposition to still get orthonormal factors?
The Singular Value Decomposition uses two different orthonormal bases and non-negative singular values, recovering the "orthogonal stretch" picture without needing .
If two symmetric matrices and commute (), what can you say about their eigenvectors?
They can be simultaneously orthogonally diagonalized — a shared orthonormal eigenbasis exists, so one diagonalizes both.
Recall One-line summary to lock in
Real spectrum, orthogonal eigenvectors, never defective ::: These three are the whole theorem; every trap above is just one of them being doubted, over-generalized, or applied to a non-symmetric matrix.