Intuition The big picture (WHY this exists)
A Taylor polynomial P n ( x ) P_n(x) P n ( x ) approximates a function f ( x ) f(x) f ( x ) near a point a a a . But an approximation is useless unless you can answer: "How wrong am I?" The remainder theorem gives you a provable bound on the gap f ( x ) − P n ( x ) f(x) - P_n(x) f ( x ) − P n ( x ) so you can say "my answer is correct to within 0.0001 0.0001 0.0001 " with total confidence.
Definition Taylor polynomial and remainder
The degree-n n n Taylor polynomial of f f f centered at a a a is
P n ( x ) = ∑ k = 0 n f ( k ) ( a ) k ! ( x − a ) k . P_n(x) = \sum_{k=0}^{n} \frac{f^{(k)}(a)}{k!}(x-a)^k. P n ( x ) = ∑ k = 0 n k ! f ( k ) ( a ) ( x − a ) k .
The remainder (the exact error) is defined as ==R n ( x ) = f ( x ) − P n ( x ) R_n(x) = f(x) - P_n(x) R n ( x ) = f ( x ) − P n ( x ) ==.
WHAT we want: a usable formula for R n ( x ) R_n(x) R n ( x ) .
WHY we can't just compute it: if we knew f ( x ) f(x) f ( x ) exactly we wouldn't need the approximation. So we need a bound .
We derive it from the Mean Value Theorem , generalised. Here is the cleanest route.
Derivation (Cauchy MVT trick). Fix x x x . Treat a a a as a variable t t t and define
g ( t ) = f ( x ) − ∑ k = 0 n f ( k ) ( t ) k ! ( x − t ) k . g(t) = f(x) - \sum_{k=0}^{n}\frac{f^{(k)}(t)}{k!}(x-t)^k. g ( t ) = f ( x ) − ∑ k = 0 n k ! f ( k ) ( t ) ( x − t ) k .
Why this step? g ( t ) g(t) g ( t ) is just the remainder when we center at t t t . Note g ( x ) = 0 g(x)=0 g ( x ) = 0 (Taylor polynomial centered at x x x equals f ( x ) f(x) f ( x ) ) and g ( a ) = R n ( x ) g(a)=R_n(x) g ( a ) = R n ( x ) .
Differentiate g ( t ) g(t) g ( t ) . Almost everything telescopes:
g ′ ( t ) = − f ( n + 1 ) ( t ) n ! ( x − t ) n . g'(t) = -\frac{f^{(n+1)}(t)}{n!}(x-t)^{n}. g ′ ( t ) = − n ! f ( n + 1 ) ( t ) ( x − t ) n .
Why this step? The product-rule terms from consecutive k k k cancel — that's the magic of the Taylor structure. Only the top derivative survives.
Now introduce h ( t ) = ( x − t ) n + 1 h(t) = (x-t)^{n+1} h ( t ) = ( x − t ) n + 1 , so h ( x ) = 0 h(x)=0 h ( x ) = 0 , h ( a ) = ( x − a ) n + 1 h(a)=(x-a)^{n+1} h ( a ) = ( x − a ) n + 1 , and h ′ ( t ) = − ( n + 1 ) ( x − t ) n h'(t) = -(n+1)(x-t)^n h ′ ( t ) = − ( n + 1 ) ( x − t ) n .
Apply the Cauchy Mean Value Theorem to g g g and h h h on [ a , x ] [a,x] [ a , x ] : there is c c c between a a a and x x x with
g ( a ) − g ( x ) h ( a ) − h ( x ) = g ′ ( c ) h ′ ( c ) . \frac{g(a)-g(x)}{h(a)-h(x)} = \frac{g'(c)}{h'(c)}. h ( a ) − h ( x ) g ( a ) − g ( x ) = h ′ ( c ) g ′ ( c ) .
Why this step? Cauchy MVT compares the rates of two functions; it lets the unknown c c c appear.
Substitute everything:
R n ( x ) − 0 ( x − a ) n + 1 − 0 = − f ( n + 1 ) ( c ) n ! ( x − c ) n − ( n + 1 ) ( x − c ) n = f ( n + 1 ) ( c ) ( n + 1 ) ! . \frac{R_n(x) - 0}{(x-a)^{n+1}-0} = \frac{-\frac{f^{(n+1)}(c)}{n!}(x-c)^n}{-(n+1)(x-c)^n} = \frac{f^{(n+1)}(c)}{(n+1)!}. ( x − a ) n + 1 − 0 R n ( x ) − 0 = − ( n + 1 ) ( x − c ) n − n ! f ( n + 1 ) ( c ) ( x − c ) n = ( n + 1 )! f ( n + 1 ) ( c ) .
The ( x − c ) n (x-c)^n ( x − c ) n cancels, giving exactly the Lagrange form. ■ \blacksquare ■
You don't know c c c . But you don't need it — you only need an upper bound on ∣ f ( n + 1 ) ∣ |f^{(n+1)}| ∣ f ( n + 1 ) ∣ .
HOW to use it (recipe):
Pick centre a a a , degree n n n , target point x x x .
Find f ( n + 1 ) f^{(n+1)} f ( n + 1 ) and a bound M = max ∣ f ( n + 1 ) ∣ M = \max |f^{(n+1)}| M = max ∣ f ( n + 1 ) ∣ on the interval [ a , x ] [a,x] [ a , x ] .
Plug into the box.
Worked example (A) Estimate
e 0.1 e^{0.1} e 0.1 with P 2 P_2 P 2 , bound the error
f ( x ) = e x f(x)=e^x f ( x ) = e x , a = 0 a=0 a = 0 , n = 2 n=2 n = 2 . So P 2 ( x ) = 1 + x + x 2 2 P_2(x)=1+x+\tfrac{x^2}{2} P 2 ( x ) = 1 + x + 2 x 2 , giving P 2 ( 0.1 ) = 1.105 P_2(0.1)=1.105 P 2 ( 0.1 ) = 1.105 .
Bound: f ( 3 ) ( t ) = e t f^{(3)}(t)=e^t f ( 3 ) ( t ) = e t . On [ 0 , 0.1 ] [0,0.1] [ 0 , 0.1 ] the max is e 0.1 < e 0.5 < 2 e^{0.1}<e^{0.5}<2 e 0.1 < e 0.5 < 2 , so take M = 2 M=2 M = 2 .
Why M = 2 M=2 M = 2 ? We need an upper bound that's easy; e 0.1 ≈ 1.105 < 2 e^{0.1}\approx1.105<2 e 0.1 ≈ 1.105 < 2 comfortably.
∣ R 2 ( 0.1 ) ∣ ≤ 2 3 ! ( 0.1 ) 3 = 2 6 ( 0.001 ) ≈ 3.3 × 10 − 4 . |R_2(0.1)|\le \frac{2}{3!}(0.1)^3 = \frac{2}{6}(0.001)\approx 3.3\times10^{-4}. ∣ R 2 ( 0.1 ) ∣ ≤ 3 ! 2 ( 0.1 ) 3 = 6 2 ( 0.001 ) ≈ 3.3 × 1 0 − 4 .
True value e 0.1 = 1.10517... e^{0.1}=1.10517... e 0.1 = 1.10517... , actual error ≈ 1.7 × 10 − 4 \approx1.7\times10^{-4} ≈ 1.7 × 1 0 − 4 — inside our bound. ✓
Worked example (B) How many terms to compute
e e e to 10 − 6 10^{-6} 1 0 − 6 ?
f ( x ) = e x f(x)=e^x f ( x ) = e x , a = 0 a=0 a = 0 , x = 1 x=1 x = 1 . Then f ( n + 1 ) = e t ≤ e < 3 f^{(n+1)}=e^t\le e<3 f ( n + 1 ) = e t ≤ e < 3 on [ 0 , 1 ] [0,1] [ 0 , 1 ] , take M = 3 M=3 M = 3 .
∣ R n ( 1 ) ∣ ≤ 3 ( n + 1 ) ! . |R_n(1)|\le \frac{3}{(n+1)!}. ∣ R n ( 1 ) ∣ ≤ ( n + 1 )! 3 .
Why this step? ∣ x − a ∣ n + 1 = 1 |x-a|^{n+1}=1 ∣ x − a ∣ n + 1 = 1 , so the bound is purely 3 / ( n + 1 ) ! 3/(n+1)! 3/ ( n + 1 )! . Demand it < 10 − 6 <10^{-6} < 1 0 − 6 :
( n + 1 ) ! > 3 × 10 6 (n+1)! > 3\times10^6 ( n + 1 )! > 3 × 1 0 6 . Since 10 ! = 3628800 > 3 × 10 6 10!=3628800>3\times10^6 10 ! = 3628800 > 3 × 1 0 6 , take n + 1 = 10 ⇒ n = 9 n+1=10\Rightarrow n=9 n + 1 = 10 ⇒ n = 9 .
Answer: 9th degree polynomial (terms up to x 9 / 9 ! x^9/9! x 9 /9 ! ) suffices.
sin ( 0.2 ) \sin(0.2) sin ( 0.2 ) with P 3 P_3 P 3
f ( x ) = sin x f(x)=\sin x f ( x ) = sin x , a = 0 a=0 a = 0 . P 3 ( x ) = x − x 3 6 P_3(x)=x-\tfrac{x^3}{6} P 3 ( x ) = x − 6 x 3 , P 3 ( 0.2 ) = 0.2 − 0.001333 = 0.198667 P_3(0.2)=0.2-0.001333=0.198667 P 3 ( 0.2 ) = 0.2 − 0.001333 = 0.198667 .
f ( 4 ) ( t ) = sin t f^{(4)}(t)=\sin t f ( 4 ) ( t ) = sin t , and ∣ sin t ∣ ≤ 1 |\sin t|\le 1 ∣ sin t ∣ ≤ 1 , so M = 1 M=1 M = 1 .
∣ R 3 ( 0.2 ) ∣ ≤ 1 4 ! ( 0.2 ) 4 = 0.0016 24 ≈ 6.7 × 10 − 5 . |R_3(0.2)|\le \frac{1}{4!}(0.2)^4=\frac{0.0016}{24}\approx 6.7\times10^{-5}. ∣ R 3 ( 0.2 ) ∣ ≤ 4 ! 1 ( 0.2 ) 4 = 24 0.0016 ≈ 6.7 × 1 0 − 5 .
True sin 0.2 = 0.198669 \sin0.2=0.198669 sin 0.2 = 0.198669 , error ≈ 2 × 10 − 6 \approx 2\times10^{-6} ≈ 2 × 1 0 − 6 . Bound holds (and is conservative). ✓
c = x c=x c = x or c = a c=a c = a into the Lagrange term."
Why it feels right: c c c is some number in the interval, so why not pick an end? Fix: c c c is unknown ; you must use M = max ∣ f ( n + 1 ) ∣ M=\max|f^{(n+1)}| M = max ∣ f ( n + 1 ) ∣ over the whole interval, not a single guessed point. Otherwise your bound may be too small and wrong.
( n ) ! (n)! ( n )! instead of ( n + 1 ) ! (n+1)! ( n + 1 )! ."
Why it feels right: P n P_n P n has top term f ( n ) ( a ) / n ! f^{(n)}(a)/n! f ( n ) ( a ) / n ! , so n ! n! n ! feels natural. Fix: the remainder involves the next derivative f ( n + 1 ) f^{(n+1)} f ( n + 1 ) , so the factorial is ( n + 1 ) ! (n+1)! ( n + 1 )! and the power is ( x − a ) n + 1 (x-a)^{n+1} ( x − a ) n + 1 . Match them.
Common mistake "Forgetting
∣ x − a ∣ n + 1 |x-a|^{n+1} ∣ x − a ∣ n + 1 when a ≠ 0 a\neq 0 a = 0 or ∣ x − a ∣ > 1 |x-a|>1 ∣ x − a ∣ > 1 ."
Why it feels right: in textbook examples x − a x-a x − a is often small, so the power looks negligible. Fix: if ∣ x − a ∣ > 1 |x-a|>1 ∣ x − a ∣ > 1 the power grows and can dominate — always keep it.
Recall Feynman: explain to a 12-year-old
Imagine drawing a smooth hill from memory with a few pencil strokes (that's the Taylor polynomial). The remainder theorem is a rule that tells you: "your sketch is off by at most this much ." To find that "this much", you check how wildly the hill bends (the next derivative) on the stretch you drew, multiply by how far you walked, and divide by a big factorial number that quickly makes the error tiny. So a few strokes can be guaranteed almost perfect for a short walk.
Mnemonic Remember the bound
"Next derivative, Next factorial, Next power."
M ( n + 1 ) ! ∣ x − a ∣ n + 1 \dfrac{M}{(n+1)!}|x-a|^{n+1} ( n + 1 )! M ∣ x − a ∣ n + 1 — everything is n + 1 n+1 n + 1 (one step beyond the polynomial).
What is the definition of the Taylor remainder R n ( x ) R_n(x) R n ( x ) ? R n ( x ) = f ( x ) − P n ( x ) R_n(x)=f(x)-P_n(x) R n ( x ) = f ( x ) − P n ( x ) , the exact error of the degree-
n n n approximation.
State the Lagrange form of the remainder. R n ( x ) = f ( n + 1 ) ( c ) ( n + 1 ) ! ( x − a ) n + 1 R_n(x)=\dfrac{f^{(n+1)}(c)}{(n+1)!}(x-a)^{n+1} R n ( x ) = ( n + 1 )! f ( n + 1 ) ( c ) ( x − a ) n + 1 for some
c c c between
a a a and
x x x .
What is the standard error bound? ∣ R n ( x ) ∣ ≤ M ( n + 1 ) ! ∣ x − a ∣ n + 1 |R_n(x)|\le \dfrac{M}{(n+1)!}|x-a|^{n+1} ∣ R n ( x ) ∣ ≤ ( n + 1 )! M ∣ x − a ∣ n + 1 where
M ≥ ∣ f ( n + 1 ) ∣ M\ge|f^{(n+1)}| M ≥ ∣ f ( n + 1 ) ∣ on the interval.
Which derivative and factorial appear in the bound? The
( n + 1 ) (n+1) ( n + 1 ) -th derivative and
( n + 1 ) ! (n+1)! ( n + 1 )! — one step beyond the polynomial degree
n n n .
Why can't you pick a specific value for c c c ? c c c is unknown; you must bound
∣ f ( n + 1 ) ∣ |f^{(n+1)}| ∣ f ( n + 1 ) ∣ by its max
M M M over the whole interval instead.
For e x e^x e x at a = 0 a=0 a = 0 , why is the error easy to bound on [ 0 , 1 ] [0,1] [ 0 , 1 ] ? All derivatives are
e t ≤ e < 3 e^t\le e<3 e t ≤ e < 3 , so
M = 3 M=3 M = 3 works for every
n n n .
How many terms give e e e to within 10 − 6 10^{-6} 1 0 − 6 ? Need
3 / ( n + 1 ) ! < 10 − 6 ⇒ ( n + 1 ) ! > 3 × 10 6 ⇒ n = 9 3/(n+1)!<10^{-6}\Rightarrow(n+1)!>3\times10^6\Rightarrow n=9 3/ ( n + 1 )! < 1 0 − 6 ⇒ ( n + 1 )! > 3 × 1 0 6 ⇒ n = 9 .
What MVT result powers the derivation? The Cauchy (generalised) Mean Value Theorem applied to
g ( t ) g(t) g ( t ) and
h ( t ) = ( x − t ) n + 1 h(t)=(x-t)^{n+1} h ( t ) = ( x − t ) n + 1 .
Taylor & Maclaurin Series — the polynomial P n P_n P n this bounds.
Mean Value Theorem / Cauchy Mean Value Theorem — engine of the derivation.
Radius of Convergence — series converges iff R n ( x ) → 0 R_n(x)\to 0 R n ( x ) → 0 .
Alternating Series Estimation Theorem — alternative error bound for alternating series.
Big-O and asymptotic error — R n = O ( ∣ x − a ∣ n + 1 ) R_n=O(|x-a|^{n+1}) R n = O ( ∣ x − a ∣ n + 1 ) near a a a .
gives exact Rn at unknown c
Cauchy Mean Value Theorem
Bound M on n+1 derivative
Intuition Hinglish mein samjho
Dekho, Taylor polynomial P n ( x ) P_n(x) P n ( x ) kisi function f ( x ) f(x) f ( x ) ko ek point a a a ke aas-paas approximate karta hai — jaise thodi si pencil strokes se ek smooth curve ka sketch banana. Lekin sketch tab tak useless hai jab tak hum bata na paayein ki "galti kitni hai". Yahi kaam karta hai remainder theorem : yeh error R n ( x ) = f ( x ) − P n ( x ) R_n(x)=f(x)-P_n(x) R n ( x ) = f ( x ) − P n ( x ) par ek guaranteed upper bound deta hai.
Core formula simple hai aur sab kuch n + 1 n+1 n + 1 par chalta hai: ∣ R n ( x ) ∣ ≤ M ( n + 1 ) ! ∣ x − a ∣ n + 1 |R_n(x)| \le \dfrac{M}{(n+1)!}|x-a|^{n+1} ∣ R n ( x ) ∣ ≤ ( n + 1 )! M ∣ x − a ∣ n + 1 . Yahan M M M matlab agle (next) derivative f ( n + 1 ) f^{(n+1)} f ( n + 1 ) ki maximum value us interval par. Mnemonic yaad rakho — "Next derivative, Next factorial, Next power". Lagrange form mein ek unknown point c c c aata hai jo Cauchy Mean Value Theorem se nikalta hai; hum c c c ko exactly nahi jaante, isliye uski jagah M M M (maximum) le lete hain — yeh sabse common confusion hai, ise mat bhoolna.
Practically yeh bahut powerful hai. Jaise example: e e e ko 10 − 6 10^{-6} 1 0 − 6 accuracy tak nikalna ho, to bound 3 / ( n + 1 ) ! < 10 − 6 3/(n+1)! < 10^{-6} 3/ ( n + 1 )! < 1 0 − 6 solve karo, n = 9 n=9 n = 9 aata hai — bas 10 terms kaafi! Factorial neeche hone ki wajah se error super-fast chhota hota jaata hai. Isiliye chhote ∣ x − a ∣ |x-a| ∣ x − a ∣ ke liye kuch hi terms se almost perfect answer milta hai, aur hum mathematically prove bhi kar sakte hain.