4.5.19Linear Algebra (Full)

Coordinate vectors — change of basis

1,440 words7 min readdifficulty · medium4 backlinks

WHAT is a coordinate vector?

WHY is it unique? Because B\mathcal{B} is linearly independent. If two expansions existed, subtracting them gives a non-trivial combination equal to 0\mathbf{0} — contradicting independence. Uniqueness is the whole reason coordinates are well-defined.


The change-of-basis problem

You know [v]B[\mathbf{v}]_{\mathcal{B}}. You want [v]C[\mathbf{v}]_{\mathcal{C}} for another basis C\mathcal{C}. We want a matrix PP with [v]C=PCB  [v]B.[\mathbf{v}]_{\mathcal{C}} = \underset{\mathcal{C}\leftarrow\mathcal{B}}{P}\;[\mathbf{v}]_{\mathcal{B}}.

HOW — derive PP from scratch

Start from what [v]B[\mathbf{v}]_{\mathcal{B}} means: v=c1b1++cnbn.\mathbf{v} = c_1\mathbf{b}_1 + \cdots + c_n\mathbf{b}_n.

Now take coordinates of both sides relative to C\mathcal{C}. The coordinate map []C[\,\cdot\,]_{\mathcal{C}} is linear (proved below), so [v]C=c1[b1]C++cn[bn]C.[\mathbf{v}]_{\mathcal{C}} = c_1[\mathbf{b}_1]_{\mathcal{C}} + \cdots + c_n[\mathbf{b}_n]_{\mathcal{C}}.

The right side is exactly a matrix times [c1cn]\begin{bmatrix}c_1\\\vdots\\c_n\end{bmatrix} where the columns are [bj]C[\mathbf{b}_j]_{\mathcal{C}}. Therefore:

Why coordinate maps are linear: writing u=aibi\mathbf{u}=\sum a_i\mathbf{b}_i and w=dibi\mathbf{w}=\sum d_i\mathbf{b}_i, then u+αw=(ai+αdi)bi\mathbf{u}+\alpha\mathbf{w}=\sum(a_i+\alpha d_i)\mathbf{b}_i, so [u+αw]B=[u]B+α[w]B[\mathbf{u}+\alpha\mathbf{w}]_{\mathcal{B}} = [\mathbf{u}]_{\mathcal{B}}+\alpha[\mathbf{w}]_{\mathcal{B}}. Done.

Inverse and the standard-basis shortcut

Swapping roles gives PBC\underset{\mathcal{B}\leftarrow\mathcal{C}}{P}, and PBC=(PCB)1.\underset{\mathcal{B}\leftarrow\mathcal{C}}{P} = \Big(\underset{\mathcal{C}\leftarrow\mathcal{B}}{P}\Big)^{-1}. Why? Translating to C\mathcal{C} then back to B\mathcal{B} must do nothing: their product is II.

Figure — Coordinate vectors — change of basis

Worked examples


Mistakes (Steel-manned)


Active recall

Recall Quick self-test (cover the answers)
  • Q: What are the columns of PCB\underset{\mathcal{C}\leftarrow\mathcal{B}}{P}? → [bj]C[\mathbf{b}_j]_{\mathcal{C}}.
  • Q: In Rn\mathbb{R}^n with bases-as-columns B,CB,C, what is PCB\underset{\mathcal{C}\leftarrow\mathcal{B}}{P}? → C1BC^{-1}B.
  • Q: Relation between PCB\underset{\mathcal{C}\leftarrow\mathcal{B}}{P} and PBC\underset{\mathcal{B}\leftarrow\mathcal{C}}{P}? → inverses.
  • Q: Why is [v]B[\mathbf{v}]_{\mathcal{B}} unique? → basis is linearly independent.
What is the coordinate vector [v]B[\mathbf{v}]_{\mathcal{B}}?
The unique column of scalars cic_i such that v=cibi\mathbf{v}=\sum c_i\mathbf{b}_i.
Why are coordinates unique?
Because a basis is linearly independent, so the expansion is unique.
What are the columns of the change-of-basis matrix PCBP_{\mathcal{C}\leftarrow\mathcal{B}}?
The old basis vectors expressed in the new basis: [bj]C[\mathbf{b}_j]_{\mathcal{C}}.
For Rn\mathbb{R}^n with B,CB,C holding basis vectors as columns, PCB=?P_{\mathcal{C}\leftarrow\mathcal{B}}=?
C1BC^{-1}B.
How do PCBP_{\mathcal{C}\leftarrow\mathcal{B}} and PBCP_{\mathcal{B}\leftarrow\mathcal{C}} relate?
They are inverses of each other.
Does changing basis change the vector?
No — only its coordinate description changes; the vector is invariant.
Why is the coordinate map linear?
Adding/scaling vectors adds/scales their B\mathcal{B}-coefficients termwise.
Recall Feynman: explain to a 12-year-old

Imagine the same toy on a treasure map. One friend measures from the door, another from the window. The toy hasn't moved, but the two friends write down different "steps left, steps up" numbers. Change of basis is the little rulebook that turns one friend's numbers into the other's — just translating directions, never moving the toy.

Connections

  • Basis and dimension — coordinates exist only once a basis is fixed.
  • Linear independence — guarantees coordinate uniqueness.
  • Invertible matricesB,CB,C invertible because their columns are bases.
  • Similar matrices and diagonalizationA=P1APA'=P^{-1}AP is change of basis for operators.
  • Linear transformations and their matrices — coordinate maps make abstract maps concrete.

Concept Map

expanded in

gives scalars

guarantees

makes well-defined

translated by

justifies

built from

old vectors in new coords

swap roles

as matrix columns

special case of

Vector v abstract arrow

Basis B ordered

Linear independence

Coordinate vector v_B

Unique expansion

Coordinate map is linear

Change-of-basis matrix P

Columns are b_j in C coords

Inverse P for reverse

Standard basis shortcut P equals B

Hinglish (regional understanding)

Intuition Hinglish mein samjho

Dekho, ek vector v\mathbf{v} asal mein ek arrow hai jo space mein already exist karta hai — basis choose karne se pehle. Jab hum koi basis B\mathcal{B} pick karte hain, tab us arrow ko describe karne ke liye numbers ki list milti hai, jise hum coordinate vector [v]B[\mathbf{v}]_{\mathcal{B}} kehte hain. Yeh list isliye unique hoti hai kyunki basis linearly independent hota hai — do alag descriptions possible hi nahi.

Ab change of basis ka matlab: arrow wahi ka wahi rehta hai, sirf numbers badalte hain jab basis badalta hai. Translation matrix PCB\underset{\mathcal{C}\leftarrow\mathcal{B}}{P} ke columns kya hote hain? Purane basis vectors bj\mathbf{b}_j, lekin naye basis ki language mein likhe huye, yaani [bj]C[\mathbf{b}_j]_{\mathcal{C}}. Yahi sabse common galti hai — log naye vectors daal dete hain, jabki purane daalne hote hain (kyunki matrix purane numbers ko khaata hai).

Rn\mathbb{R}^n mein agar BB aur CC apne basis vectors ko columns mein rakhein, to formula seedha hai: PCB=C1B\underset{\mathcal{C}\leftarrow\mathcal{B}}{P}=C^{-1}B. Right se padho — BB tumhe B\mathcal{B} se standard mein le jaata hai, phir C1C^{-1} standard se C\mathcal{C} mein. Beech ka "standard" cancel ho jaata hai. Aur reverse matrix uska inverse hota hai, kyunki idhar jaake wapas aana = kuch nahi karna = II.

Yeh topic kyun matter karta hai? Kyunki diagonalization (A=P1APA'=P^{-1}AP), eigenbasis, aur har "achhe coordinates mein problem aasaan ho jaati hai" wali trick — sab change of basis hi hai. Ek baar yeh clear, to poori linear algebra clean lagne lagti hai.

Go deeper — visual, from zero

Test yourself — Linear Algebra (Full)

Connections