4.5.6 · D5Linear Algebra (Full)

Question bank — Matrices — review, operations, types

1,487 words7 min readBack to topic

Reminder of the vocabulary these questions lean on: a matrix is a grid of numbers standing for a linear transformation; the product means "do first, then "; the transpose swaps rows and columns; singular means (no inverse); orthogonal means . Every answer below re-explains the "why", so you never need to have memorised these.


True or false — justify

Matrix addition is commutative: for matrices of the same order.
True — addition is entrywise, and each number-pair obeys ordinary number commutativity. The "do B first" ordering issue only appears in multiplication.
Matrix multiplication is commutative.
False — means "do then "; swapping to changes the order of actions (like socks-then-shoes vs shoes-then-socks), so generally .
If exists, then must also exist.
False — needs columns of = rows of . A times a gives , but the reverse is times : existing but a different shape, so they can't even be equal.
Every square matrix commutes with the identity: .
True — is the "do nothing" transformation, so applying it before or after changes nothing. Identity is the one matrix that always commutes with everything.
If and , then is symmetric.
False — , which equals only if and commute. Two symmetric matrices need not commute, so their product is usually not symmetric.
The diagonal of any skew-symmetric matrix is all zeros.
True — skew means , so on the diagonal , forcing , hence .
Every orthogonal matrix is invertible.
True — means is the inverse. Orthogonal matrices are rotations/reflections; they preserve lengths and can always be undone.
If then has no inverse.
True — the determinant measures how the transformation scales area/volume; a zero means it collapses space onto a lower dimension, and you cannot un-flatten it. See Determinant and Inverse of a Matrix.
for a scalar .
True — a scalar scales the whole transformation's output uniformly, so it can slide freely to either factor. Scalars carry no "order", unlike matrices.
The transpose of a sum is the sum of transposes: .
True — transposing just relabels entry by entry, and addition is entrywise, so the two operations don't interfere.

Spot the error

", since transpose distributes over products."
Wrong — the correct reversal law is . Transpose reverses roles and order (socks-and-shoes); usually has mismatched inner dimensions and doesn't even exist.
", so either or ."
Wrong — matrices have zero divisors. E.g. with neither factor zero. Cancellation only holds for invertible matrices.
" implies ."
Wrong — you may only cancel when is invertible. If is singular it can collapse different inputs to the same output, so is possible.
"Multiplying matrices means multiplying corresponding entries, just like adding."
Wrong — that's the Hadamard product, which doesn't compose transformations. Real multiplication is (row of )·(column of ) as a dot product, forced by .
" for matrices."
Wrong — expanding gives , and in general, so the middle can't be combined into . The binomial shortcut needs commutativity.
"Since , matrix must be the identity."
Wrong — reflections also square to (reflect twice = original). E.g. squares to but isn't . See Eigenvalues and Eigenvectors (eigenvalues ).
"A matrix can be added to a matrix by lining them up."
Wrong — addition pairs entry with , which only exists when both dimensions match. Different shapes have no natural pairing.
" and are the same matrix."
Wrong — for a non-square they even have different sizes ( vs ), and for square they generally differ unless is normal. Order matters here too.

Why questions

Why must the inner dimensions match for to exist?
Because entry is a dot product of a row of with a column of ; a dot product needs the same number of terms on both sides, i.e. columns of = rows of .
Why is matrix multiplication defined by row·column and not entrywise?
So that — the product must represent doing transformation then . Entrywise multiplication would not compose maps or solve linear systems.
Why does the transpose reverse the order of a product?
Transpose swaps rows and columns, effectively viewing the map "from the output side". Composition read backwards flips both the roles and the order, giving .
Why does every square matrix split uniquely into a symmetric plus a skew-symmetric part?
Write : the first piece equals its own transpose (symmetric), the second equals minus its transpose (skew), and the split is forced.
Why does signal no inverse?
The determinant is the area/volume scaling factor of the transformation. Zero means space is squashed flat, so distinct inputs merge — that collapse can't be reversed, hence no inverse.
Why do orthogonal matrices preserve lengths?
If , then . The length is unchanged, so it's a rotation or reflection.
Why is the identity matrix the multiplicative "1" of matrices?
It's the "do nothing" transformation: . Just as multiplying a number by 1 leaves it unchanged, composing with leaves any map unchanged.
Why can be non-commutative even when both are diagonal?
It isn't — two diagonal matrices do commute, since each just scales independent axes and scaling factors multiply order-freely. Non-commutativity needs mixing of axes (rotation, shear).

Edge cases

What is the product of a row matrix with an column matrix?
A matrix — a single number, exactly the dot product of the two vectors. This is why matrix product entries are dot products.
Is the matrix symmetric, skew-symmetric, or both?
Symmetric always (); skew-symmetric only if , since skew forces the (only) diagonal entry to vanish. The zero matrix is both.
Can a matrix be both symmetric and skew-symmetric?
Yes, but only the zero matrix. and give , so , hence .
Is the zero matrix orthogonal?
No — orthogonality requires , but for the zero matrix . The zero map collapses everything and preserves no lengths.
What happens when you multiply any matrix by the zero matrix (of compatible size)?
You get the zero matrix — every output entry is a dot product with an all-zero row or column. This holds even though neither factor being zero was required for a zero product elsewhere.
Is a matrix's multiplication commutative?
Yes — it's just ordinary number multiplication, . Non-commutativity is a genuinely higher-dimensional phenomenon.
Does every non-zero matrix have an inverse?
No — only square, non-singular matrices do. Non-square matrices and square matrices with (e.g. any matrix with a zero row) have no two-sided inverse.
If is with two identical rows, what is , and is invertible?
, so is singular and non-invertible — identical rows mean the transformation collapses a dimension, squashing volume to zero.
Recall One-line summary of the traps

Entrywise for add/scale, dot-products for multiply; order matters (, ); cancel only when invertible; collapses space; zero products don't force zero factors.

Connections