4.7.17Partial Differential Equations

Sturm-Liouville theory — eigenvalue problems, orthogonality of eigenfunctions

1,974 words9 min readdifficulty · medium6 backlinks

1. What is a Sturm–Liouville problem?

WHAT each piece means:

  • p(x)p(x) — the "stiffness"/diffusion coefficient.
  • q(x)q(x) — a potential/source-like term.
  • w(x)w(x) — the weight; it defines the inner product (CRUCIAL for orthogonality).
  • λ\lambda — the eigenvalue (e.g. λn=(nπ/L)2\lambda_n=(n\pi/L)^2 in the heat equation).

Why ANY linear 2nd-order ODE can be put in SL form (derivation)

Start from the general form a2(x)y+a1(x)y+a0(x)y+λy=0.a_2(x)y'' + a_1(x)y' + a_0(x)y + \lambda y = 0. We want (py)=py+py(p y')' = p y'' + p' y'. Divide by a2a_2 and multiply by an integrating factor μ(x)\mu(x): μy+μa1a2y+\mu y'' + \mu\frac{a_1}{a_2}y' + \cdots For this to equal (μy)=μy+μy(\mu y')' = \mu y'' + \mu' y' we need μ=μa1a2\mu' = \mu\,\dfrac{a_1}{a_2}, so   μ(x)=exp ⁣(a1a2dx)  \boxed{\;\mu(x)=\exp\!\left(\int \frac{a_1}{a_2}\,dx\right)\;} Then p=μp=\mu, q=μa0/a2q=\mu\,a_0/a_2, w=μ/a2w=\mu/a_2. Why this step? The integrating factor is exactly what turns two separate terms into one perfect derivative — the same trick as first-order linear ODEs.


2. Boundary conditions that make it "regular"


3. The Main Theorem (the 80/20 core)

3.1 Derive orthogonality FROM SCRATCH (the key result)

Let ym,yny_m,y_n solve the SL equation with eigenvalues λm,λn\lambda_m,\lambda_n: (pym)+(q+λmw)ym=0,(pyn)+(q+λnw)yn=0.(p y_m')' + (q+\lambda_m w)y_m = 0,\qquad (p y_n')' + (q+\lambda_n w)y_n=0. Multiply the first by yny_n, the second by ymy_m, subtract: yn(pym)ym(pyn)+(λmλn)wymyn=0.y_n(p y_m')' - y_m(p y_n')' + (\lambda_m-\lambda_n)\,w\,y_m y_n = 0. Why subtract? The qymynq\,y_my_n terms cancel, isolating the eigenvalue difference.

Now note Lagrange's identity: yn(pym)ym(pyn)=ddx[p(ynymymyn)].y_n(p y_m')' - y_m(p y_n')' = \frac{d}{dx}\big[p(y_n y_m' - y_m y_n')\big]. Why this step? Expand the RHS: p(ynymymyn)+p(ynymymyn)p'(y_ny_m'-y_my_n') + p(y_ny_m''-y_my_n'') — exactly the LHS. It packages everything into a total derivative so we can integrate cleanly.

Integrate from aa to bb: [p(ynymymyn)]ab+(λmλn)abwymyndx=0.\big[p(y_n y_m' - y_m y_n')\big]_a^b + (\lambda_m-\lambda_n)\int_a^b w\,y_m y_n\,dx = 0. The boundary term is the Wronskian-like bracket [pW(ym,yn)]ab\big[p\,W(y_m,y_n)\big]_a^b.

Why the boundary term vanishes: At x=ax=a, the separated BC α1ym(a)+α2ym(a)=0\alpha_1 y_m(a)+\alpha_2 y_m'(a)=0 and α1yn(a)+α2yn(a)=0\alpha_1 y_n(a)+\alpha_2 y_n'(a)=0 are two equations for (α1,α2)(0,0)(\alpha_1,\alpha_2)\ne(0,0). A nonzero solution forces the determinant ym(a)yn(a)yn(a)ym(a)=0y_m(a)y_n'(a)-y_n(a)y_m'(a)=0, i.e. W(ym,yn)a=0W(y_m,y_n)|_a=0. Same at bb. Hence the bracket is 00.

Therefore (λmλn)abwymyndx=0.(\lambda_m-\lambda_n)\int_a^b w\,y_m y_n\,dx = 0. Since λmλn\lambda_m\ne\lambda_n, the integral is zero. \blacksquare Orthogonality with weight ww.

3.2 Why eigenvalues are real (same machinery)

Take complex yy with eigenvalue λ\lambda, and its conjugate yˉ\bar y with λˉ\bar\lambda (since p,q,wp,q,w real). The same subtraction gives (λλˉ)wy2dx=0(\lambda-\bar\lambda)\int w|y|^2dx=0. As wy2>0\int w|y|^2>0, we get λ=λˉ\lambda=\bar\lambda, i.e. real.


4. Eigenfunction expansion — getting the coefficients

Why this works: orthogonality kills every term except m=nm=n — exactly like projecting a vector onto an orthogonal axis: cm=f,ymwym,ymwc_m = \dfrac{\langle f,y_m\rangle_w}{\langle y_m,y_m\rangle_w}.

Figure — Sturm-Liouville theory — eigenvalue problems, orthogonality of eigenfunctions

5. Worked Examples


6. Common Mistakes (Steel-man + Fix)


Recall Feynman: explain to a 12-year-old

Imagine a guitar string. When you pluck it, it only vibrates in special shapes — one bump, two bumps, three bumps. You can't get "two and a half bumps." Those allowed shapes are the eigenfunctions, and how fast each one wiggles is the eigenvalue. The cool trick: these shapes are so "independent" that any wiggle of the string is just a recipe — some of shape-1, some of shape-2, etc. To find how much of shape-2 you have, you "compare" your wiggle only against shape-2; all the other shapes politely give zero. That polite-zero property is orthogonality. Sturm–Liouville theory is the rulebook that promises these special shapes always exist and always behave this nicely.


7. Flashcards

What is the standard Sturm–Liouville form of a 2nd-order ODE?
(p(x)y)+(q(x)+λw(x))y=0(p(x)y')' + (q(x)+\lambda w(x))y = 0 with p,w>0p,w>0 and homogeneous BCs.
What does the weight function w(x)w(x) determine?
The inner product for orthogonality: abymynwdx\int_a^b y_m y_n\,w\,dx.
State the orthogonality relation of SL eigenfunctions.
abym(x)yn(x)w(x)dx=0\int_a^b y_m(x)y_n(x)w(x)\,dx = 0 for mnm\ne n.
Integrating factor to convert a2y+a1y+a0y+λy=0a_2y''+a_1y'+a_0y+\lambda y=0 to SL form?
μ(x)=exp(a1a2dx)\mu(x)=\exp\left(\int \frac{a_1}{a_2}dx\right); then p=μp=\mu, q=μa0/a2q=\mu a_0/a_2, w=μ/a2w=\mu/a_2.
Why are SL eigenvalues real?
Subtracting the equation for yy and yˉ\bar y gives (λλˉ)wy2dx=0(\lambda-\bar\lambda)\int w|y|^2dx=0; since the integral >0>0, λ=λˉ\lambda=\bar\lambda.
What identity packages yn(pym)ym(pyn)y_n(py_m')'-y_m(py_n')' into a derivative?
Lagrange's identity: ddx[p(ynymymyn)]\frac{d}{dx}[p(y_ny_m'-y_my_n')].
Why does the boundary term vanish in the orthogonality proof?
Separated BCs force the Wronskian ymynynym=0y_my_n'-y_ny_m'=0 at each endpoint (or p=0p=0 there).
Formula for expansion coefficient cmc_m in f=cnynf=\sum c_n y_n?
cm=abfymwdxabym2wdxc_m=\dfrac{\int_a^b f y_m w\,dx}{\int_a^b y_m^2 w\,dx}.
Eigenvalues/eigenfunctions of y+λy=0y''+\lambda y=0, y(0)=y(L)=0y(0)=y(L)=0?
λn=(nπ/L)2\lambda_n=(n\pi/L)^2, yn=sin(nπx/L)y_n=\sin(n\pi x/L), n=1,2,n=1,2,\dots, weight w=1w=1.
Why can periodic SL problems have multiplicity-2 eigenvalues?
They are not regular SL problems; simplicity is only guaranteed for regular separated-BC problems.

8. Connections

  • Separation of Variables — produces the SL problem from a PDE.
  • Fourier Series — the special case w=1w=1, sin/cos\sin/\cos basis.
  • Bessel Functions — singular SL with weight w=xw=x.
  • Legendre Polynomials — singular SL on [1,1][-1,1], w=1w=1.
  • Hilbert Space and Inner Products — orthogonality as projection.
  • Heat Equation / Wave Equation — eigenfunction expansions of solutions.

Concept Map

separation of variables

has form

integrating factor mu

requires

finite interval p,w positive

contains

guarantees

gives

gives

defines inner product for

enables

special cases

PDE heat wave Laplace

Spatial ODE

Sturm-Liouville problem

General 2nd-order ODE

Homogeneous BCs

Regular SL problem

Weight w x

SL Theorem

Real increasing eigenvalues

Orthogonal eigenfunctions

Eigenfunction expansion

Fourier Bessel Legendre series

Hinglish (regional understanding)

Intuition Hinglish mein samjho

Dekho, jab bhi hum koi PDE — heat equation, wave equation, ya Laplace — ko separation of variables se solve karte hain, to space-wala part hamesha ek special ODE ban jaata hai: (py)+(q+λw)y=0(p y')' + (q + \lambda w)y = 0. Isko Sturm–Liouville problem kehte hain. Yahan λ\lambda wo special numbers hain (eigenvalues) jinke liye non-zero solution milta hai, aur wo solutions yny_n eigenfunctions hain — bilkul guitar string ke alag-alag vibration shapes jaise (ek bump, do bump, teen bump).

Sabse bada point yeh hai: yeh eigenfunctions orthogonal hote hain, lekin ek weight function w(x)w(x) ke saath: abymynwdx=0\int_a^b y_m y_n\,w\,dx = 0 jab mnm \ne n. Yeh exactly vectors ke perpendicular hone jaisa hai. Isi wajah se hum kisi bhi function ff ko in eigenfunctions ke combination mein likh sakte hain, aur har coefficient cmc_m ko alag se nikaal sakte hain — kyunki baaki saare terms orthogonality se zero ho jaate hain. Yahi Fourier series, Bessel series, Legendre series sab ke peeche ka asli raaz hai.

Orthogonality ka proof yaad rakhna easy hai: dono equations ko cross-multiply karke subtract karo, Lagrange identity se total derivative banao, integrate karo — to ek boundary term aata hai jo BCs ki wajah se zero ho jaata hai, aur bachta hai (λmλn)wymyn=0(\lambda_m - \lambda_n)\int w y_m y_n = 0. Eigenvalues alag hain to integral zero. Bas yahi pura khel hai.

Sabse common galti: students w(x)w(x) ko bhool jaate hain aur weight 11 maan lete hain. Lekin Euler-type ya Bessel mein weight 1/x1/x ya xx hota hai. Isliye hamesha pehle ODE ko proper SL form mein likho (integrating factor μ=exp(a1/a2)dx\mu = \exp\int (a_1/a_2)dx se), tabhi sahi ww milega. Yeh chhoti si baat exam mein bohot marks bachati hai!

Test yourself — Partial Differential Equations

Connections