4.6.32Ordinary Differential Equations

Convolution theorem — proof, applications

1,551 words7 min readdifficulty · medium6 backlinks

WHAT is convolution?

WHY this particular form? Because Laplace transforms turn integrals/derivatives into algebra, and the product F(s)G(s)F(s)G(s) "wants" exactly this overlapping integral — we'll see why in the proof.


THE CONVOLUTION THEOREM

Derivation from scratch (no formula dump)

Step 1 — Write both transforms as integrals. F(s)G(s)=(0esσf(σ)dσ)(0esτg(τ)dτ)F(s)G(s)=\left(\int_0^\infty e^{-s\sigma}f(\sigma)\,d\sigma\right)\left(\int_0^\infty e^{-s\tau}g(\tau)\,d\tau\right) Why this step? We use different dummy variables σ,τ\sigma,\tau so we can merge into one double integral without confusion.

Step 2 — Combine into a double integral. F(s)G(s)=0 ⁣ ⁣0es(σ+τ)f(σ)g(τ)dσdτF(s)G(s)=\int_0^\infty\!\!\int_0^\infty e^{-s(\sigma+\tau)}f(\sigma)g(\tau)\,d\sigma\,d\tau Why this step? A product of integrals over independent variables is one double integral over the quarter-plane σ,τ0\sigma,\tau \ge 0.

Step 3 — Change variables to make the exponent look like este^{-st}. Let t=σ+τt=\sigma+\tau (so the exponent becomes este^{-st}). Keep τ\tau as the other variable, so σ=tτ\sigma = t-\tau. Why this step? We are aiming for the standard form 0est()dt\int_0^\infty e^{-st}(\cdots)\,dt, which would identify the bracket as a Laplace transform.

The Jacobian of (σ,τ)(t,τ)(\sigma,\tau)\to(t,\tau) is 11 (since σ=tτ, τ=τ\sigma=t-\tau,\ \tau=\tau). New region: τ0\tau\ge0 and σ=tτ00τt\sigma=t-\tau\ge0\Rightarrow 0\le\tau\le t, with tt from 00 to \infty.

F(s)G(s)=t=0τ=0testf(tτ)g(τ)dτdtF(s)G(s)=\int_{t=0}^\infty\int_{\tau=0}^{t} e^{-st} f(t-\tau)g(\tau)\,d\tau\,dt

Step 4 — Recognise the inner integral. =0est[0tf(tτ)g(τ)dτ]=(fg)(t)dt=L{fg}.=\int_0^\infty e^{-st}\underbrace{\left[\int_0^t f(t-\tau)g(\tau)\,d\tau\right]}_{=(f*g)(t)}dt=\mathcal{L}\{f*g\}. Why this step? The inner integral is exactly the convolution (using gf=fgg*f=f*g). Done. \blacksquare

Figure — Convolution theorem — proof, applications

APPLICATIONS

App 1 — Inverse Laplace without partial fractions

App 2 — Solving ODEs / integral equations

App 3 — Volterra integral equations


COMMON MISTAKES


Recall Feynman: explain to a 12-year-old

Imagine two machines. Machine ff drops sand at different times; machine gg says how long each grain keeps glowing after it lands. The brightness right now (tt) is the sum of glows from all grains dropped earlier, each grain dimmed by how much time has passed since it landed. Adding up "what was dropped at time τ\tau × how much it still glows after tτt-\tau" — that adding-up is convolution. The magic theorem says: in a special math language (Laplace), this complicated adding-up becomes just multiply two numbers.


Active Recall

Define the convolution (fg)(t)(f*g)(t).
0tf(τ)g(tτ)dτ\int_0^t f(\tau)g(t-\tau)\,d\tau, arguments add to tt.
State the convolution theorem.
L{fg}=F(s)G(s)\mathcal{L}\{f*g\}=F(s)G(s), equivalently L1{F(s)G(s)}=fg\mathcal{L}^{-1}\{F(s)G(s)\}=f*g.
Is convolution commutative? Prove the idea.
Yes; substitute u=tτu=t-\tau to swap ff and gg.
Why does product in ss-world become convolution, not product, in tt-world?
Because F(s)G(s)F(s)G(s) is a double integral over σ+τ=t\sigma+\tau=t diagonals (Jacobian 1), giving 0tf(tτ)g(τ)dτ\int_0^t f(t-\tau)g(\tau)d\tau.
What is L1{1/(s2(s2+1))}\mathcal{L}^{-1}\{1/(s^2(s^2+1))\}?
tsintt-\sin t.
What is sintsint\sin t * \sin t?
12(sinttcost)\tfrac12(\sin t - t\cos t).
Why is the convolution upper limit tt?
Causality: g(tτ)=0g(t-\tau)=0 for τ>t\tau>t, so contribution vanishes.
How do convolutions help solve Volterra integral equations?
An integral 0ty(τ)k(tτ)dτ\int_0^t y(\tau)k(t-\tau)d\tau Laplaces to Y(s)K(s)Y(s)K(s), turning the equation into algebra.

Connections

Concept Map

defined as

arguments sum to t

substitution u equals t minus tau

Step 1 two dummy vars

Step 2 merge

Step 3 t equals sigma plus tau, Jacobian 1

Step 4 recognise inner

transforms to

inverse form

avoids

Convolution f star g

Integral 0 to t of f tau g t minus tau

tau plus t minus tau equals t

Commutativity f star g equals g star f

Laplace F of s times G of s

Product of two integrals

Double integral over quarter plane

Region 0 to t inner

Convolution Theorem L of f star g equals F G

L inverse of F G equals f star g

Partial fractions

Hinglish (regional understanding)

Intuition Hinglish mein samjho

Dekho, Convolution theorem ka core idea bilkul simple hai: Laplace world (jaha sab kuch ss ke terms me hai) me agar do functions ka product F(s)G(s)F(s)G(s) aata hai, to time world me uska inverse koi simple multiplication nahi hota — wo ek special integral hota hai jise convolution kehte hain: (fg)(t)=0tf(τ)g(tτ)dτ(f*g)(t)=\int_0^t f(\tau)g(t-\tau)d\tau. Yaad rakhne ka trick: dono arguments add hoke tt ban jaate hain (τ+(tτ)=t\tau + (t-\tau)=t).

Proof ka soul ye hai: F(s)G(s)F(s)G(s) ko do alag dummy variables σ,τ\sigma,\tau ke saath ek double integral bana do, fir t=σ+τt=\sigma+\tau substitute karo (Jacobian 1 hota hai), aur jadoo se andar wala integral exactly convolution ban jaata hai. Geometrically, hum quarter-plane ke diagonals σ+τ=t\sigma+\tau=t pe sum kar rahe hain — yahi convolution hai.

Iska faayda kya? Do badi jagah. Pehla: inverse Laplace bina partial fractions ke nikal lo — jaise 1/(s2(s2+1))1/(s^2(s^2+1)) ko 1/s21/(s2+1)1/s^2 \cdot 1/(s^2+1) likh ke tsint=tsintt * \sin t = t - \sin t. Dusra: ODEs aur Volterra integral equations (jaha integral me y(τ)k(tτ)y(\tau)k(t-\tau) aata hai) ko algebra me convert karke easily solve karo.

Sabse common galti: students product in ss ko product in tt samajh lete hain — galat. Product in ss = convolution in tt. Aur upper limit hamesha tt hoti hai, \infty nahi, kyunki causal functions me g(tτ)=0g(t-\tau)=0 jab τ>t\tau>t. Bas isko rato mat, "FLIP-and-SLIDE" picture imagine karo — ek function ulta karke doosre ke upar slide karte ho, overlap ka area hi convolution value hai.

Go deeper — visual, from zero

Test yourself — Ordinary Differential Equations

Connections