1.2.1 · D5Calculus & Optimization Basics

Question bank — Functions, limits, and continuity

1,936 words9 min readBack to topic

Before we start, let's earn every symbol and picture this page will lean on.

Notation earned first

Figure — Functions, limits, and continuity
Figure — Functions, limits, and continuity
Figure — Functions, limits, and continuity

Now the three words this page stress-tests:


True or false — justify

A function can have two different inputs give the same output.
True. "Exactly one output per input" is a one-way rule; sends both and to , and that is perfectly legal.
If then .
False. The limit ignores the point ; can be missing or set to any wrong value (a hole), yet the limit is still . Equality only holds when is continuous at .
and are the same function.
False. They agree everywhere except , where is undefined () but . Different domains means different functions, even though their limits at both equal .
Every continuous function is differentiable.
False. Continuity forbids jumps and holes but not corners; ReLU and are continuous everywhere yet have no single slope at .
Every differentiable function is continuous.
True. Having a well-defined slope requires the graph to arrive exactly where it heads — a jump or hole would make the difference quotient blow up, so differentiability forces continuity (see Derivatives and gradients).
A limit that produces does not exist.
False. is an indeterminate form, a signal to simplify — factor, rationalize, or use L'Hôpital's Rule. The limit may exist perfectly well (e.g. it is for at ).
If both one-sided limits exist, the two-sided limit exists.
False. They must also be equal. A step function has a left limit and a right limit at the step, but they differ, so the two-sided limit does not exist (a jump discontinuity).
Redefining a single point can turn a discontinuous function into a continuous one.
True — but only for removable discontinuities. If the limit exists, set equal to it and the hole is patched. Jumps and infinite blow-ups cannot be fixed by moving one point.
defines as a function of .
False. At it gives both and ; a vertical line at cuts the curve twice, failing the "exactly one output" rule.
Continuity of and guarantees continuity of (their composition).
True. A chain of continuous machines stays continuous — this is the backbone of backprop; see Continuity of composite functions.

Spot the error

"To find , plug in : you get , so the limit is undefined."
The error is treating as a verdict. It is a prompt to factor: for , giving limit .
" is continuous because its formula has no gaps."
The formula is fine, but is not in the domain and there — an infinite discontinuity. Continuity is only claimed on the domain; you cannot ignore where the machine has no output.
"The limit as of is because we plugged in ."
The value is correct, but plugging in is only valid because is continuous — a conclusion, not the definition. The honest route: we want the output-gap below any ; since it equals (input-gap), forcing the input-gap under makes the output-gap under — hence choose .
"ReLU has a jump at , so gradient descent breaks."
ReLU has no jump — its two one-sided limits at both equal (continuous). It has a corner (non-differentiability), handled by a subgradient, so Gradient Descent still works.
"Since maps to a single output under , and so does , the square-root relation with is also a function."
The relation gives two outputs per input, failing the vertical line test. Only the positive-root choice is a function.
"A hole in the graph means the limit doesn't exist there."
A removable hole means is missing, but the two-sided limit can still exist and equal the height of the hole — that is exactly the removable case.

Why questions

Why does the limit definition use the strict instead of ?
The strict excludes itself, encoding "we track the journey, not the arrival". Without it, a bad value at could wreck a perfectly good limit.
Why does ML insist on continuous (and mostly differentiable) loss functions?
Gradient Descent follows the slope downhill; a jump has no meaningful slope and a hole has no value, so the ball can't roll smoothly — continuity is what makes the slope trustworthy.
Why is factoring allowed inside a limit even though it cancels the term that is zero?
Because the limit never evaluates at , only near it, so throughout — dividing by it is legal on the domain the limit actually sees.
Why is "the vertical line test" the right test for functionhood?
A vertical line fixes one input and reads off every output the curve gives there; two hits mean two outputs for one input, violating "exactly one output".
Why is continuity weaker than differentiability?
Continuity only asks the graph to arrive where it heads (no jump/hole); differentiability additionally demands a single slope, which corners like ReLU's kink at fail to provide.
Why can a jump discontinuity never be fixed by redefining one point?
The left and right limits disagree, so no single value can equal both headings at once; you'd need to move a whole side, not one point.

Edge cases

Is a constant function continuous everywhere?
Yes. For every , and ; the heading and arrival always match, so the pen never lifts.
What is ?
Does not exist. From the right , from the left ; the one-sided limits disagree, so the two-sided limit fails — a jump.
What is , and which break-type is it?
Does not exist — an oscillatory (essential) discontinuity. As the input races through infinitely many cycles, so keeps sweeping between and forever, never settling on a heading. It neither jumps nor blows up.
Is continuous at every point of its domain?
Yes. On its domain (all ) it has no breaks; simply isn't in the domain, so it isn't a discontinuity of the function — it's outside where the machine operates.
At the corner of ReLU (), what exists and what doesn't?
The value and the limit both exist and agree (continuous), but the slope does not exist uniquely (left slope , right slope ) — non-differentiable.
Can a function be defined at , have a limit at , yet still be discontinuous at ?
Yes. If exists and exists but they are unequal (a misplaced point), condition 3 fails — a removable discontinuity.
What happens to continuity at an endpoint of a closed interval, say for on ?
We use the one-sided limit: , so is (right-)continuous at the endpoint even though no left side exists.

Recall One-line survival guide

Approach ≠ Arrive. Limit = where you're heading; value = where you land; continuous = they match. = simplify, not surrender. Continuous is weaker than differentiable. Two-sided limit exists only when both one-sided doors agree. Always check domain before declaring continuity.

Connections