4.5.15 · D2Linear Algebra (Full)

Visual walkthrough — Linear independence — formal definition, testing

1,811 words8 min readBack to topic

Step 1 — What is a vector, and what is an arrow doing?

WHAT. A vector in is just a pair of numbers, like . We picture it as an arrow starting at the origin (the point ) and ending at that pair of coordinates. The first number says how far right, the second how far up.

WHY. Everything that follows — "combining vectors", "reaching a point" — is easier to trust when you see it as arrows you can lay end to end. We need this picture locked in before any algebra.

PICTURE. The red arrow is : 3 across, 1 up. The cyan arrow is .

Figure — Linear independence — formal definition, testing

Step 2 — What is a linear combination? (scaling and adding arrows)

WHAT. Take a number (a scalar) and a vector . Then stretches the arrow by factor : is twice as long, flips it to point backwards, crushes it to . Adding two vectors means putting them tip to tail.

Term by term: stretches ; stretches ; the lays the second stretched arrow onto the tip of the first. The final tip is where you land.

WHY. The definition of independence is entirely about combinations equalling . So we must first see, physically, what a combination looks like — a recipe of stretches that carries you to a destination.

PICTURE. Amber dashed arrows show and laid tip to tail; the black arrow is where their sum lands.

Figure — Linear independence — formal definition, testing

Step 3 — The special destination: landing back at the origin

WHAT. Now we ask the key question: can a combination land you back at ? That is, can you pick scalars so that There is always one boring way: — take no steps at all, you never leave the origin. That is the trivial solution.

WHY. Returning to with nonzero steps means the arrows secretly cancel — one arrow's stretch is undone by the others. That cancellation is exactly redundancy. So "can we hit the exciting way?" is the independence question.

PICTURE. Left: independent arrows — the only way back to is take-no-steps. Right: two parallel arrows — you can walk out along one and walk back along the other, a nonzero round trip to .

Figure — Linear independence — formal definition, testing

Step 4 — Why a nonzero round trip = "one vector is a copy of the others"

WHAT. Suppose an exciting solution exists, say . Divide the whole equation by and move terms across: Reading it: equals a scaled copy of . The number is just the stretch factor. So carried no new direction — it was a passenger.

WHY. This is the bridge between the algebra (equation ) and the intuition ("no vector built from the others") that the parent note promised. Seeing it geometrically makes it undeniable.

PICTURE. The red arrow sits exactly along the line through the cyan arrow — same line, different length. Redundancy made visible.

Figure — Linear independence — formal definition, testing

Step 5 — Packing the question into a matrix

WHAT. Stack the vectors as columns of a matrix and collect the scalars into a column . Then the matrix–vector product is the linear combination: So the independence question becomes: does have only ? — a homogeneous system.

WHY. Drawing arrows works for 2 or 3 vectors, but in higher dimensions we need machinery. A matrix lets a computer (or row reduction) answer the same geometric question. Nothing new is happening — just repackaging Steps 2–4.

PICTURE. The two arrows slide in to become the two columns of ; the label shows how column scalar rebuilds the combination.


Step 6 — Counting pivots: the actual test

WHAT. Row-reduce to staircase form and count pivots (the leading nonzero entry of each nonzero row). A column with no pivot corresponds to a free variable — a knob you can turn freely, giving infinitely many nonzero solutions.

  • Pivot in every column only independent.
  • A pivotless column free variable exciting solutions exist dependent.

WHY. This turns "can we hit the exciting way?" into a finite, mechanical count. See rank — it is the number of independent columns.

PICTURE. Two staircases: left has a pivot in each column (independent); right has a zero row, so its last column is pivotless — a free variable, dependence.


Step 7 — The square shortcut: determinant = signed area

WHAT. When you have exactly vectors in (a square ), the determinant measures the (signed) area/volume the arrows enclose. If they're dependent they lie on a line/plane — the enclosed area collapses to .

WHY. It's a one-number test only when square. Term by term for : is the area of the parallelogram the two columns span; area means they're parallel (Step 4's picture).

PICTURE. Left: independent pair spans a real parallelogram (amber fill, area ). Right: parallel pair — the parallelogram is squashed flat, area .


Step 8 — Every edge case, drawn

WHAT. Three scenarios the count of pivots handles automatically:

  1. Zero vector present. If , then is an exciting solution (). Always dependent.
  2. Too many vectors ( dimension). is short and wide, so at most (dimension) pivots for more columns a pivotless column always exists. Always dependent — you can't have more independent directions than the space has.
  3. A single nonzero vector. One arrow that isn't can only reach by . Always independent.

WHY. The parent note listed these as rules; here you see why each is forced, so you never meet a case unprepared.

PICTURE. Three panels: the flattened arrow; three fat columns in a 2-row matrix with a guaranteed free column; a lone nonzero arrow that only trivially cancels.


The one-picture summary

One figure, the whole chain: arrows → combination → return to ? → columns of → pivots → independent or dependent, with the square-case determinant shortcut branching off.

Recall Feynman retelling — the walkthrough in plain words

Picture arrows from the middle of the page. A "combination" is a recipe: stretch this one by so much, that one by so much, lay them tip to tail, see where you land. The whole game is one question: can a recipe with real (nonzero) stretches carry you back to the exact centre? If the only way home is "take no steps", your arrows are all pulling in genuinely different directions — independent. But if you can march out along one arrow and sneak back along the others, then one of them was a copy in disguise — dependent, a passenger. To check without drawing, stand the arrows up as the columns of a box called and row-reduce it: count the "steps" (pivots) in the staircase. A pivot for every column means no free knob to turn, so only the do-nothing recipe reaches zero — independent. A missing pivot is a free knob — spin it and you find a real round trip to zero — dependent. When the box is square you get a bonus: the determinant is the area the arrows enclose, and a squashed-flat area (zero) is the same as "dependent". And the tricky freebies: a zero arrow is always a passenger; more arrows than the space has dimensions must have a passenger; a single non-zero arrow never does.


Connections