1.2.13 · D1Calculus & Optimization Basics

Foundations — Learning rate effects on convergence

2,004 words9 min readBack to topic

Before you can read the parent note Learning rate effects on convergence, you must be able to read every squiggle it uses without hesitation. This page builds each one from nothing, in an order where every symbol is earned by the one before it. Nothing here assumes you have seen calculus notation before.


1. The parameter — "the knob we turn"

In the parent note you see with a little subscript . That just labels which step in time we are at: is the starting knob setting, is after one adjustment, after two, and so on. The subscript is a counter, nothing more.


2. The loss — "how wrong we are"

The notation is read "L of theta": you hand it a knob setting , it hands you back a wrongness number. The parentheses mean "feed this in", exactly like a vending machine slot.


3. Slope, and why we need the gradient

Suppose you are standing blindfolded on the loss landscape. You want to go downhill but you cannot see the whole valley — you can only feel the ground right under your feet. What can you feel? The slope: which way is up, which way is down, and how steep it is.

Now, most models have many knobs at once. The slope in each knob direction gets bundled into one arrow. That bundle is the gradient.

The little subscript in just says "take the slopes with respect to the knobs " — it names which sliders we're feeling under our feet. The superscript you sometimes see () is the "transpose" — a bookkeeping mark that lets two arrows be multiplied into a single number (a dot product). You do not need it to grasp the idea of a step. See Gradient Descent for how the arrow drives every update.


4. — "the step we actually take"


5. — the learning rate itself

Now we can finally define the star of the topic honestly, because every piece it depends on exists.

is called a hyperparameter: a number you pick before training, as opposed to which the training learns. Later notes replace the single fixed with smarter schemes — see Learning Rate Schedules, Momentum, and Adam Optimizer.


6. Symbols that appear in the stability analysis

The parent note's "does it converge?" section uses three more symbols. Meet them now so nothing surprises you.


Prerequisite map

Parameter theta - the knob we turn

Loss L of theta - wrongness score

Slope and Gradient nabla - steepest uphill arrow

Delta theta - the step we take

Learning rate eta - step length

Smoothness L and curvature lambda

Stability rule eta below 2 over L

Convergence regimes - slow, just right, diverge

Every arrow means "you need the left box to understand the right box." Notice the two streams — the step-building stream (top) and the curvature stream (bottom) — meet at the stability rule, which is the heart of the parent topic.


Equipment checklist

Cover the right side and answer each. If any answer surprises you, reread that section.

What does represent, in plain words?
The setting(s) / knob(s) we are allowed to adjust to improve the model.
What does the subscript in mean?
A time/step counter — which iteration we are on.
What does give you when you feed in a ?
A single number measuring how wrong that setting is (loss / height on the landscape).
Which direction does point?
Steepest uphill — so we move opposite it to go down.
Why is there a minus sign in ?
To turn the uphill gradient into a downhill move.
What does mean?
The change in the knob during one update, .
In one phrase, what is ?
The step length — how far we move per update.
Direction vs distance: which does the gradient give, and which does give?
Gradient gives direction; gives distance.
What does a large smoothness constant force you to do with ?
Make smaller (sharper valleys need shorter steps); rule is .
For the bowl , what is the curvature and the stability limit on ?
, so .
What is the sole purpose of in the adaptive-rate denominator?
To prevent division by zero (tiny safety constant).

Recall Quick self-check before moving on

If you can read out loud as a full sentence and point to the picture for each symbol, you are ready for the parent note. Read the update rule as an English sentence. ::: Next setting = current setting minus (step length) times (steepest-uphill arrow) — i.e. take a step of size downhill.