4.10.26 · D1Advanced Topics (Elite Level)

Foundations — Fourier analysis — DFT, FFT algorithm (Cooley-Tukey)

2,500 words11 min readBack to topic

This page assumes you know nothing about the notation on the parent topic. We build every symbol from the ground up, in an order where each one only uses things already defined.


0. What a "signal" and a "sample" even are

  • is just an index: it names which reading, counting from . So is the first, the second, and so on.
  • is the total count of readings.
  • We start counting at , so the last index is , not . This "off by one" is a lifelong habit in this subject — get comfortable now.
Figure — Fourier analysis — DFT, FFT algorithm (Cooley-Tukey)

Why the topic needs it: the whole DFT eats a list and spits out another list. If you don't picture the input as dots on a timeline, nothing later has a home.


1. Complex numbers — arrows in a plane

The parent page is full of , , and bars over letters. All of it lives in one picture: a point (or arrow) in a flat plane.

Figure — Fourier analysis — DFT, FFT algorithm (Cooley-Tukey)
  • The horizontal axis is the real axis, the vertical axis is the imaginary axis.
  • Look at the red arrow in the figure: its length is and the angle it makes with the right-pointing axis is .

Why the topic needs it: the parent's line " for real input" is a mirror-symmetry statement. Without the bar picture it's gibberish; with it, it just says two output arrows are mirror images.


2. The exponential — a point on the unit circle

This is the single most important symbol on the whole parent page, so we earn it carefully.

Figure — Fourier analysis — DFT, FFT algorithm (Cooley-Tukey)

Read the figure slowly:

  • Every sits on the circle of radius 1 (the "unit circle"), because always.
  • Increasing by a little rotates the red dot a little counter-clockwise.
  • is measured in radians: a full trip around the circle is radians (not ). So — you're back where you started.

Why the topic needs it: the "pure rotating waves" the parent talks about are literally with marching forward. Each DFT frequency is one such spinning arrow.

Recall Why is

a rotation and not just growth? Ordinary (real ) grows. Multiplying the exponent by turns "grow outward" into "turn sideways", so the value circles instead of escaping. ::: The factor converts stretching into turning.


3. Roots of unity — evenly spaced points on the circle

Now the star of the parent formula: .

Before we go further, meet the two letters the parent formula uses as exponents on :

Figure — Fourier analysis — DFT, FFT algorithm (Cooley-Tukey)

In the figure (): the red dot is , one step clockwise from . The other black dots are its powers — you visit every dot and land back on after steps, because:

Two facts the parent leans on, now obvious from the picture. Both need to be even so that is a whole number (radix-2 FFT always uses , which is even):

The first makes the FFT split possible; the second makes the "butterfly" nearly free. Both are pictures of stepping around a circle, nothing more.

Why the topic needs it: is the "frequency dial". The weight in the DFT sum says "spin sample by notches" — see Roots of Unity for the full geometry.


4. Sums — the symbol

Why the topic needs it: the DFT (here is the fixed frequency index from Section 3, and runs over all samples) is "for one output , spin every sample and add them all up". The is the and add them all up part.


5. Geometric series — why orthogonality works

The parent's proof that the basis waves are independent rests on one classic sum.

The magic in the DFT: the ratio is itself a root of unity, so , which makes the top . The whole sum collapses to zero. That single line is why different frequencies don't leak into each other — see Geometric Series and Linear Algebra — Orthogonal Bases.

Why the topic needs it: "orthogonal basis" is a fancy way of saying each frequency can be measured on its own without solving a big equation system. The geometric series is the engine that proves it.


6. Orthogonal bases — measuring one ingredient at a time

Why the topic needs it: the whole derivation of the DFT is "project onto orthogonal waves". Full background: Linear Algebra — Orthogonal Bases.


7. Big-O and divide-and-conquer — measuring speed

The FFT half of the parent page is about cost, not values.

Why the topic needs it: this is literally why the FFT is famous — not new math, just a faster route to the same DFT numbers.


Prerequisite map

Complex numbers as arrows

e to the i theta = point on circle

Roots of unity omega N

Sigma sum notation

DFT formula X k

Geometric series

Orthogonal bases

Divide and conquer

FFT Cooley Tukey

Master Theorem

Convolution Theorem

Sampling and Aliasing

Downstream, these feed Convolution Theorem, Continuous Fourier Transform, and Sampling & Aliasing (Nyquist) — but you don't need those to read the parent.


Equipment checklist

Test yourself — cover the right side. If any answer surprises you, re-read that section before the parent.

What does the index in mean, and where does it start?
It names which reading; it starts at , so the last index is .
What single equation defines the imaginary unit ?
.
Draw/describe as a picture.
An arrow to the point right, up in the plane.
What is the length of , and why?
, by Pythagoras on the right triangle with legs and .
What does the conjugate do geometrically?
Reflects the arrow across the real (horizontal) axis.
What point on the plane is ?
The unit-circle point at angle (length 1), from Euler's formula .
How many radians is one full turn, and what is ?
radians; .
In words, what is ?
One clockwise step to the next of evenly spaced dots on the unit circle.
What do and mean, and what range does take?
names which frequency; is the -th DFT output.
Why does ?
steps of size complete a full lap back to .
State the two symmetries of (and the condition on ).
For even : and .
What does instruct you to do?
Add through .
Derive for .
Multiply-by- trick: , so .
Why is that sum for a root of unity?
makes the numerator .
What does the inner product mean?
The two length- lists have zero overlap (orthogonal).
What does the recurrence solve to?
, via the Master Theorem.