3.5.35 · D5Guidance, Navigation & Control (GNC)
Question bank — Linear Quadratic Regulator (LQR) — Riccati equation, optimal gains
True or false — justify
Doubling both and (keeping their ratio fixed) changes the optimal gain .
False. Only the ratio sets aggressiveness; scaling both by the same factor leaves the minimizer of unchanged, so is identical.
The Riccati matrix is always symmetric.
True. is the matrix of the quadratic value function ; only its symmetric part contributes to a quadratic form, so we take by construction.
If the open-loop plant is already stable, LQR is unnecessary.
False. Stability is not optimality — an already-stable plant can still be sluggish or fuel-wasteful, and LQR finds the control that minimizes the combined error-plus-effort cost.
Increasing makes the closed-loop response faster.
False. Larger penalizes control effort more, so the optimizer uses less actuation, giving a slower, gentler response. Larger speeds it up.
may be merely positive semidefinite (some zero eigenvalues) as long as .
False. must be strictly positive definite so exists in and the cost is strictly convex in ; a zero direction in would allow infinite free control.
For a controllable, observable system the stabilizing is unique.
True. Under controllable and observable, the CARE has a unique symmetric that makes Hurwitz; the other algebraic roots are non-stabilizing.
LQR guarantees a closed loop with all poles in the left half-plane.
True (under the standard conditions). The stabilizing Riccati solution is defined precisely as the one rendering Hurwitz, so every closed-loop eigenvalue has negative real part.
The optimal control law is time-varying over the infinite horizon.
False. In the infinite-horizon steady state , so and hence are constant — a single fixed gain applied for all time.
LQR requires you to measure the full state .
True. The law needs every state; when only outputs are measured you must estimate (e.g. a Kalman Filter), producing LQG Control.
The value function could have a linear term, e.g. .
False. Cost-to-go from the origin is zero and the problem is symmetric under , so is a pure quadratic with no linear or constant term.
Spot the error
"The gain is ."
Missing the : the correct gain is . This factor is exactly why must be invertible.
"The Riccati equation is ."
The quadratic term must be negative: . That minus sign is what the optimizer "saves" by controlling; a plus sign has no stabilizing solution.
"We pick whichever root of the Riccati equation is easiest to compute."
You must pick the stabilizing root — the unique making Hurwitz. A root with yields a gain that destabilizes the plant.
"LQR minimizes the final error ."
It minimizes the integral over the whole trajectory, not a terminal value; the running cost trades error against effort at every instant.
"Since the plant is linear, we should use a linear cost like ."
The quadratic cost is what makes the value function quadratic and the optimal control linear (). A linear (L1) cost breaks that clean closed form and gives bang-bang-type control.
" must be positive definite."
Only (positive semidefinite) is required; you may penalize just some states. The strict condition is on , plus observability for uniqueness.
"The double-integrator LQR gives an integral (I) action like a PI controller."
It gives a PD controller: acting on position and velocity. There is no integral term because the standard LQR cost contains no integral-of-error state.
Why questions
Why does a linear plant plus quadratic cost produce a linear controller?
The quadratic cost forces a quadratic value function ; minimizing the HJB bracket over is minimizing a quadratic in , whose stationary point is linear in .
Why is the infinite-horizon Riccati equation called "algebraic"?
In steady state the cost-to-go stops changing, so and the differential Riccati ODE collapses to a purely algebraic matrix equation with no time derivative.
Why is the Riccati equation nonlinear even though the plant is linear?
The term is quadratic in the unknown , so despite linear dynamics the equation for is nonlinear.
Why does LQR stabilize even an unstable open-loop plant ( in the scalar case)?
The closed-loop pole is always negative for the positive Riccati root, so feedback overrides the unstable dynamics regardless of the sign of .
Why must and be symmetric?
In a quadratic form only the symmetric part of contributes, so any antisymmetric part is wasted; we take them symmetric without loss of generality.
Why does LQR need observable, not just controllable?
Controllability guarantees you can move every state; observability of ensures every unstable mode is actually penalized by the cost, so the optimizer has a reason to damp it — together they give a unique stabilizing .
Why is guaranteed to be a global (not just local) minimizer over ?
The HJB bracket is convex in because , so its single stationary point is the global minimum.
Why does LQR compute once, offline, rather than re-optimizing at every timestep?
The infinite-horizon steady-state gain is constant, so the entire optimization reduces to solving one CARE ahead of time; runtime is just the cheap product .
Edge cases
What is the optimal control at the target state ?
. No error means no push needed; the controller idles exactly at the setpoint.
What happens as (control effort infinitely expensive)?
The gain , so the controller does almost nothing and the closed loop approaches the open-loop dynamics — fine if the plant is already stable, disastrous if it is not.
What happens as (control effectively free)?
The controller becomes extremely aggressive with very large gains and fast poles; in the limit blows up, which is why must be strictly positive to keep well defined.
If (no state penalty at all), what does LQR do?
With nothing penalizing error, the cheapest way to minimize is ; but if is unobservable the solution may leave unstable modes uncontrolled, so is degenerate and not generally used.
Does the LQR solution depend on the initial state ?
No. The gain is the same for every starting point; the value achieved equals , which scales with , but the control rule does not.
If the plant is uncontrollable in an unstable direction, does a stabilizing LQR solution exist?
No. If an unstable mode cannot be influenced by , no feedback can move it into the left half-plane, so no stabilizing exists — controllability of the unstable part is essential.
Two Riccati roots both give symmetric ; how do you tell which is optimal?
Test the closed loop: the optimal one is the for which has all eigenvalues in the left half-plane (Hurwitz); the other yields an anti-stable closed loop.
Recall One-line self-check before moving on
If someone hands you a "faster" LQR by increasing , you should immediately object. Why? ::: Increasing penalizes effort, giving a slower response; they have the / roles backwards.