4.6.14 · D1Theory of Computation

Foundations — Variants — multi-tape TM, non-deterministic TM, all equivalent

2,125 words10 min readBack to topic

Before you can appreciate why multi-tape and non-deterministic machines are no more powerful than the basic one, you need every symbol they are built from. This page assumes nothing. We build each piece, draw it, then say why the topic needs it. Read top to bottom — each item uses only things defined above it.


0. The tape and the head — the physical picture

Everything starts with one image: an infinitely long strip of paper divided into square cells, and a little read/write head parked over one cell.

Figure — Variants — multi-tape TM, non-deterministic TM, all equivalent

Why the topic needs this. Every "variant" in the parent note is just a change to this picture: more strips (multi-tape) or more choices about where the head goes (non-deterministic). If you can see one head on one tape, you can see all the variants as edits to that drawing.


1. Symbols and alphabets — and

The head reads and writes symbols. We need names for the two pools of symbols allowed.

The picture: is the small box of letters you're allowed to start with; is the bigger box of letters you're allowed to scribble with. Always (Sigma sits inside Gamma).


2. Strings, , and length

The picture: is what's already printed on the first cells of tape 1 when the machine wakes up; everything to its right is . The number measures "how big is this problem," and every timing claim in the parent note (like ) is measured as a function of .


3. States and the control — , , accept/reject

The head needs a "mood" or "mental state" telling it what to do next. That's the finite control.

Figure — Variants — multi-tape TM, non-deterministic TM, all equivalent

The symbol (read "is an element of") just says is one of the moods listed in .


4. Sets of options — , , and

The non-deterministic definition uses and the multi-tape one uses . Let's earn both.

The picture: if is a menu, is the list of all possible combos you could order, including "order nothing" and "order everything."

Why the topic needs it. A non-deterministic machine, at one step, may have several allowed moves. "A set of allowed moves" is exactly "an element of " — so the right-hand side of the NTM transition landing in is precisely "returns a set of choices."

The picture for : instead of one head reading one symbol, imagine heads on strips; a single "reading" is now the whole row of symbols under all heads at once — that's the tuple.


5. Functions and the arrow — the transition rule

Everything above assembles into , the rulebook.

Now read the parent's two transition functions with fresh eyes:

The single visual difference: deterministic returns one arrow out of each situation; non-deterministic returns a fan of arrows.


6. Determinism vs non-determinism — line vs tree

Figure — Variants — multi-tape TM, non-deterministic TM, all equivalent

Look at the figure: on the left, one arrow leads to the next box forever — a path. On the right, boxes split into children — a tree. The parent's whole NTM→DTM simulation is just: a line-machine walks the tree of a fan-machine, one branch at a time.


7. Reading the cost symbols — , ,

The parent states timing results. Here's what those symbols say.

See Time Complexity and Big-O for the full grammar of these symbols. The picture to keep: (multi-tape slowdown) is a gentle parabola; (NTM blow-up) is a wall that shoots to the sky. Same power, wildly different speed — the seed of the P vs NP problem.


Prerequisite map

Tape and head picture

Alphabets Sigma and Gamma

Strings w and length n

States Q and control

Sets and power set

Transition function delta

Deterministic run is a line

Non-deterministic run is a tree

Multi-tape variant

Non-deterministic variant

Running time t of n and Big-O

4.6.14 All variants equivalent

Each foundation feeds the next; together they let you read every symbol in the parent theorem and follow both simulations.


Equipment checklist

Test yourself — cover the right side and answer before revealing.

What does the blank symbol mean, and why is it needed?
It marks every un-written cell as "empty"; without it a machine couldn't tell where its data ends.
Why do we keep and separate?
is what the input may contain; adds scratch symbols (like #, ) the machine writes but the input never had.
What does stand for and why is every timing claim written in terms of it?
, the input length; costs are measured as functions of input size so they're meaningful across all inputs.
Why must the state set be finite?
All unbounded memory must live on the tape; a finite control is what forces that, keeping the model honest.
Read in words.
Given a (state, symbol read), return a set of allowed (new state, symbol to write, move) outcomes — the definition of non-determinism.
What is the visual difference between a deterministic and a non-deterministic run?
Deterministic = a single straight line of configurations; non-deterministic = a branching tree that accepts if any leaf accepts.
What does contain?
Every subset of , including the empty set and itself.
Contrast the meaning of with .
The first is a gentle quadratic slowdown (multi-tape sim); the second is exponential explosion (NTM sim) — same computability, very different speed.

Ready? Return to the parent topic and the equivalence proofs will read as sentences, not symbols. Related building blocks: Turing Machine — formal definition, Church–Turing Thesis, Non-determinism in Finite Automata (NFA = DFA).