4.6.32 · D2Ordinary Differential Equations

Visual walkthrough — Convolution theorem — proof, applications

2,026 words9 min readBack to topic

If any word below is new, the parent topic note and Laplace Transform — definition and properties are the places to look first — but you shouldn't need them; we rebuild everything here.


Step 0 — The three characters (read this or nothing else works)

Before Step 1, meet the symbols. Skipping this makes every later picture meaningless.

Here are the two functions and their two transforms we'll fuse:

Notice I gave them different placeholder letters and on purpose. Step 2 will show why.


Step 1 — Draw the two transforms as areas

WHAT. Picture as the area under the curve , and as the area under . Two separate 1-D pictures, two separate axes.

WHY. You can't "combine" two things until you can see them side by side and notice they live on independent axes — one runs along , the other along . Independence is the permission slip for Step 2.

PICTURE. Left graph sweeps ; right graph sweeps . Neither knows about the other yet.

Figure — Convolution theorem — proof, applications

Each is one number: the shaded area. Their product is just (area)×(area).


Step 2 — Two areas multiplied = one volume over a plane

WHAT. Multiply the two integrals. A product of "sum over " times "sum over " is a single "sum over every pair ":

WHY. This is the ordinary rule , but for integrals. Because and never interfere (Step 1's independence), the double sum is legal. The exponentials combine: .

PICTURE. We now live on a flat quarter-plane: horizontal axis , vertical axis . Above each point sits a little tower of height . The product is the total volume of all those towers.

Figure — Convolution theorem — proof, applications

Look at the annotated exponent: it only cares about the sum , not about and separately. That observation is the seed of the whole theorem.


Step 3 — Name the sum: introduce

WHAT. The exponent is begging to be written . So define a new variable Keep as the second variable. Then automatically .

WHY. We are hunting for the shape , because that shape is, by Step 0's definition, "the Laplace transform of something." If we can bend our double integral into it, the bracket must be of — which is exactly what we want to find.

PICTURE. The lines "" are the diagonals running top-left to bottom-right. Each diagonal is one fixed value of . Coloured bands = fixed , sweeping outward.

Figure — Convolution theorem — proof, applications

Now every point on the plane is addressed by (which diagonal , how far along it ) instead of .


Step 4 — Does the area stretch? The Jacobian check

WHAT. When we relabel points, tiny area elements can grow or shrink. The Jacobian is the number by which scales to become . We must compute it or the volume comes out wrong.

WHY. Skipping this is the single most common way people "prove" the theorem and get a stray factor. Our change is — a shear (a slanting slide), and shears preserve area, so we expect . Let's confirm, not assume.

  • : push the diagonal out by , grows by .
  • : slide along the diagonal, drops as rises (they trade off, sum fixed).
  • Bottom row: is just itself.

PICTURE. A little square grid gets slanted into parallelograms of the same area — that's what looks like. No squishing, no stretching.

Figure — Convolution theorem — proof, applications

So . The volume is unchanged; only our description changed.


Step 5 — Fix the new limits (this is where causality lives)

WHAT. Under the old picture and . Translate those into the new coordinates :

  • stays .
  • becomes , i.e. .
  • Together: , and itself runs from to .

WHY. The upper limit (not !) is not a choice — it is forced by . This is exactly the "causality" the parent note warns about: you can't have used more time than has passed. On the diagonal at level , can only slide between the two axes, from up to .

PICTURE. The whole quarter-plane, re-sliced into diagonal segments. Each segment (fixed ) starts on the -axis and ends on the -axis; its length in is to .

Figure — Convolution theorem — proof, applications

Term by term: is constant along one diagonal (that's why we chose ); is the tower height re-expressed; the inner integral marches along a diagonal, the outer integral marches across diagonals.


Step 6 — Recognise the convolution, and finish

WHAT. Pull out of the inner integral (it doesn't depend on ) and stare at what's left:

WHY. The bracket is a function of alone (the got integrated away). And is literally the Laplace transform of (Step 0's definition). So .

Now identify . Compare with the parent's definition . Our bracket is exactly that — and since convolution is commutative (), we may write it either way:

PICTURE. One diagonal, extracted: it collects the product as slides from to . Flip , slide it across , multiply, add — that summed diagonal is the value .

Figure — Convolution theorem — proof, applications


Step 7 — Degenerate & edge cases (never leave a gap)


The one-picture summary

Everything above, compressed: two 1-D areas → one flat quarter-plane of towers → re-sliced along diagonals (area-preserving shear) → each diagonal is one convolution value → summed with weight = a Laplace transform.

Figure — Convolution theorem — proof, applications
Recall Feynman: tell the whole walk to a 12-year-old

Two friends each hand you a strip of coloured paper — friend 's strip is coloured by , friend 's by . Multiplying their two total colours means: lay one strip along the floor going east () and the other going north (), and at every floor tile stack a block whose height is east-colour × north-colour. The product of the two totals is just the whole pile of blocks.

Now here's the clever regrouping. Instead of counting the pile east-row by east-row, count it along diagonal lines where east+north is a fixed number . Sliding the floor into diagonal stripes doesn't squash any tile (that's the "area stays the same", the Jacobian = 1). On each diagonal stripe, the fading weight is the same everywhere — so we can pull it out front. What's left on one stripe — adding up as you walk the diagonal — is precisely the "flip-and-slide" thing called convolution. So the whole block pile equals: for each , (weight ) × (the convolution at ), added up. And "add up times something" is the definition of a Laplace transform. Therefore multiply-in--world convolve-in--world. That's the whole magic, and it was just counting the same blocks a smarter way.

Why is the right substitution?
Because the combined exponent is , and setting turns it into — the exact form inside a Laplace transform.
Where does the upper limit come from?
From ; causality forbids .
Why is the Jacobian ?
The map is a shear, and shears preserve area, so .
What is for any ?
— the integration interval has zero length.

Connections

Concept Map

Two transforms F and G as areas

Product becomes double integral

Combine exponents e to minus s times sigma plus tau

Substitute t equals sigma plus tau

Jacobian equals one shear

New limits zero to t causality

Inner integral is convolution

Outer integral is a Laplace transform

Result L of f star g equals F times G