6.5.9 · D5Research Frontiers & Practice
Question bank — Neuro-symbolic AI
Before we start, some tiny vocabulary anchors so no symbol here is unearned:
Below is the one picture you should keep in your head for every logic question on this page.

True or false — justify
A neuro-symbolic system is always more accurate than a pure neural network on the same task.
False — it trades some raw fit for consistency, sample-efficiency, and interpretability; on huge clean datasets a pure net can match or beat it, the payoff shows on small or rule-governed data.
The symbolic part of a neuro-symbolic system has to be hand-coded by a human.
Partly false — the rules are often human-given, but systems like differentiable theorem provers learn the confidence of facts and even soft rules by gradient descent, so the symbolic side is not fully manual.
Adding a symbolic constraint term can only help; a larger is always better.
False — too large a makes the model obey rules at the expense of the data, so it fits training labels poorly; is a balance to be tuned, not maximised.
Converting AND to multiplication () is exact for logical inputs.
True at the corners — plug in the four crisp cases: , , , , which is exactly the classical AND truth table; the relaxation only differs in the fuzzy middle, which is precisely where we need gradients.
Neural Module Networks require a separately trained network for every possible question.
False — the whole point is reuse: a small library of modules (
find, left_of, query_color) is composed differently per question, so one left_of serves every "left of" query.The product t-norm is the only way to relax AND.
False — it is one of several t-norms (families of fuzzy-AND): Gödel , Łukasiewicz , and product all reduce to classical AND at the corners; product is preferred here for reasons beyond "it works" (see the dedicated why-question).
A differentiable theorem prover replaces logic with a black box.
False — it keeps the logic explicit and inspectable (you can still read the rule
parent∧parent→grandparent); it only softens the true/false values to so gradients can flow.Symbolic reasoning gives you explainability for free, so neuro-symbolic models are automatically interpretable.
Mostly-but-careful — the symbolic inference chain is readable, yet the neural front-end that produced the predicates (e.g. "this pixel is a cube") is still opaque; you inherit XAI problems at the perception boundary.
Compositional generalization ("jump three times" from "jump twice") is impossible for any neural network.
False as stated — plain nets struggle with it, but architectures with explicit compositional structure (modules, attention over parts, attention mechanisms) can achieve it; it is a weakness, not a law.
Spot the error
"For mutual exclusivity of two classes we penalise ."
Wrong sign of the constraint — mutual exclusivity means the two probabilities should not both be high, so the violation is ; the stated form instead punishes them for summing to less than 1.
"In the medical example the violation was , so the constraint was satisfied."
Order flipped — the rule "pneumonia high opacity" means opacity must not fall below pneumonia, so violation , i.e. it was violated.
"We use for AND in the differentiable prover because it is smooth."
is not smooth — it has a kink along (the crease in the left panel of the figure), so its gradient is undefined there; the product t-norm is chosen precisely because it is differentiable everywhere.
"For the rule , forward chaining derives by taking over all intermediate ."
Wrong quantifier — deriving needs "there exists some linking with AND ", so we take ; existential relaxes to , whereas would encode (every must work), the wrong logic.
"NOT is relaxed as so it stays differentiable."
Leaves the interval — can go negative and is not a truth degree; the correct relaxation is , which maps and still flips .
"Because we made logic differentiable, discrete inference is no longer needed at test time."
Overreach — the differentiable form is for learning (gradients); many systems still round to crisp symbols at inference for exact, verifiable answers, so discrete logic returns at deployment.
"A symbolic prior makes the model need more data because it adds parameters."
Backwards — a good symbolic prior shrinks the hypothesis space, so fewer examples are needed; it typically adds constraints, not free parameters, aligning with few-shot learning.
" is a probability and is a fuzzy truth, so you must convert between them before reasoning."
No conversion needed — on this page both are truth values in sharing one scale; a classifier's is handed to the logic engine as directly.
Why questions
Why can't a pure neural network reliably guarantee it will never predict a person is both "awake" and "asleep"?
Its outputs are independent learned numbers with no built-in logical link; nothing forces unless a symbolic constraint injects that structure.
Why do we relax logic to instead of keeping the crisp values?
Crisp values are flat almost everywhere and jump at the boundary, giving zero or undefined gradient; a continuous relaxation gives a slope everywhere so gradient descent can actually learn confidences.
Why is the OR relaxation rather than just ?
Plain can exceed (e.g. , the dashed line leaving the box in the figure), so it is no longer a truth degree; subtracting keeps the result in and matches classical OR at the corners — this is exactly the probabilistic sum (t-conorm of the product t-norm).
Why prefer the product t-norm and probabilistic sum over Gödel (/) or Łukasiewicz () — beyond just "it's differentiable"?
Two extra reasons: (1) product/probabilistic-sum have non-zero gradients almost everywhere, whereas Gödel's / pass gradient to only one input (the winner) and Łukasiewicz clips to a flat zero region that kills learning; (2) if the truth values are read as independent probabilities, and are the exact probabilities of "both true" and "at least one true", giving the relaxation a clean probabilistic meaning.
Why does the symbolic engine let a system learn from far fewer examples than a pure net?
A rule like
a+b or parent∧parent→grandparent encodes structure that a net would otherwise have to rediscover from millions of samples; the prior supplies that knowledge for free.Why is "Neuron 4738 activated" an unacceptable answer to "why was my loan rejected?"?
It is subsymbolic — it names an internal number, not a human-meaningful reason; the symbolic layer instead yields a chain like "income < threshold AND debt-ratio high", which a person can contest.
Why does making each Neural Module reusable enable generalisation to novel questions?
Because a new question is just a new arrangement of already-learned operations; if
find, above, query_color each work alone, their fresh composition works without any new training.Why might a neuro-symbolic system connect naturally to causal reasoning and knowledge graphs?
Both express knowledge as explicit relations over named entities (edges,
causes(X,Y)), which is exactly the symbolic format the reasoning engine consumes, so the neural side can feed extracted predicates straight in.Edge cases
What does the constraint loss do when a rule is perfectly satisfied?
The violation is , so its gradient contribution vanishes — the constraint becomes silent and the model is driven purely by data until it drifts back into violation.
What happens in the product t-norm when a premise has truth degree exactly ?
The AND collapses to and, being multiplication, its gradient with respect to the other premise is also — a dead branch that cannot recover through that path, a known vanishing-signal trap.
What happens to a long AND-chain of many small-but-nonzero truth degrees, say ?
The product underflows toward zero (), so even a genuinely-supported conclusion looks false and its gradient shrinks with it; practitioners fix this by computing in the log-domain ( instead of ) or by tempering the t-norm (see next item).
What does it mean to "temper" the product t-norm to avoid underflow?
Introduce a temperature and replace with ; as grows the exponent is shrunk toward , so the chain's truth is pulled away from and toward , keeping values numerically alive and gradients non-vanishing. At this is exactly the ordinary product; large softens long conjunctions.
What happens in forward chaining if two different intermediate values both support ?
The keeps only the strongest supporting path; adding a second route does not increase the derived truth beyond the best single one, matching existential "at least one works".
What if a "fact" is given with truth degree ?
The system treats it as maximally uncertain; through the product t-norm it dampens every conclusion drawn from it, and gradients can push it toward or as evidence accumulates.
What if the symbolic rules themselves are wrong or contradictory?
The constraint then fights the data — either it forces incorrect predictions (if is high) or the data overrides it (if is low); garbage rules give a garbage prior, so rule correctness is a real assumption, not a guarantee.
What is the limiting behaviour as all truth degrees approach the crisp corners ?
Every relaxation (, , , ) converges exactly to classical logic, so a fully-confident differentiable prover behaves identically to a discrete one.
What happens if you remove the neural front-end and feed clean symbols directly?
You are left with a pure symbolic reasoner — perfect on the given predicates but blind to raw images/audio/text, which is exactly the perception gap neuro-symbolic AI was built to close (compare with RL agents that still need a perceptual encoder).
Recall One-line self-test
Can you state, without looking, why is a worse AND-relaxation than product, and why (not ) implements "there exists a linking "? ::: has a non-differentiable kink at ; encodes the existential "at least one works", whereas would wrongly demand all .