4.1.14 · D1Memory Technologies

Foundations — Memory bandwidth and latency metrics

2,163 words10 min readBack to topic

This page assumes you have seen nothing. We build every symbol the parent Memory bandwidth and latency metrics note leans on, one at a time, each earned before the next.


1. Bit and Byte — the unit of "how much"

Figure — Memory bandwidth and latency metrics

Figure 1 — one bulb is a bit; a row of eight bulbs is a byte.

Why the topic needs this: bandwidth is measured in bytes per second, so "bytes" is the stuff we are counting. If you do not know a byte is 8 bits, the " bits bytes" step in Example 1 looks like magic. It is just .


2. Bus and bus width — the "how many lanes"

Figure — Memory bandwidth and latency metrics

Figure 2 — 64 wires carry 8 bytes in one transfer, so ; more lanes = more bytes per tick.

Why this symbol? The whole reason a wide bus gives more bandwidth is that more lanes move more bytes per tick. is the "width" half of "band-width". Look at Figure 2: doubling the lanes doubles the bytes per tick without changing how long any single bit takes to arrive.


3. Second, frequency , and hertz — the "how often"

Figure — Memory bandwidth and latency metrics

Figure 3 — the faster clock (bottom) packs ticks closer, so its period is shorter.

Why the reciprocal, and why this tool? We use because latency is a time but hardware is quoted as a frequency. To turn "16 ticks of waiting" (CAS, see §8) into nanoseconds, we must know how many seconds one tick lasts — that is exactly . Look at Figure 3: the faster clock packs its ticks closer, so each tick is shorter; that is why the same count of ticks can mean less time.


4. Metric prefixes and scientific notation — reading the big/small numbers

Why the topic needs this: latency values like and bandwidths like are on wildly different scales; without prefixes the arithmetic in the worked examples is unreadable. Example: a "mega" count of million transfers per second is transfers/s. (We give the transfers-per-second idea its proper name, MT/s, in §6.)


5. Rate — the idea behind "per second"

Why this is the whole bridge: the second form () is Little's Law from Example 3: outstanding bytes bandwidth latency . If you understand "distance = speed × time", you already understand it.


6. Transfer and data rate (MT/s) — and the DDR factor of 2

Figure — Memory bandwidth and latency metrics

Figure 4 — each clock cycle has two edges (up + down); DDR fires one transfer on each, giving .

Why this tool, the "edge"? We count edges, not whole cycles, because that is literally when DDR fires a transfer. Look at Figure 4: each full cycle has two edges (up, then down), so a DDR clock delivers . The name "DDR-3200" is already the doubled number — do not double it again.


7. Channels — independent highways in parallel

Why multiplies bandwidth but not latency: adding a second highway lets twice as many cars pass per second (bandwidth ), but any single car's trip time (latency) is unchanged — it still drives one highway end to end. This is exactly the parent's Forecast answer.


8. CAS Latency (CL) — the count of cycles you wait

Why we define it here, before the formula: the parent quotes latency as "CL16" or "CL18". Because CL is measured in cycles, and a cycle's length shrinks as rises, two kits with different CL can still have the same real time. We need CL defined as a cycle-count first, then §9 converts it.


9. Putting the symbols together

Now every symbol in the parent's formulas is defined. Before we combine them, name the two results we are building toward:

With those two names in hand, re-read the parent's formulas and nothing is unknown:

Here CL (from §8) is how many clock cycles you wait before the first byte — a pure count. Multiply a count of cycles by seconds-per-cycle (, from §3) and you get seconds, just like the reciprocal rule .


Prerequisite map

The figure below shows how each foundation feeds the next, ending in the two headline results.

Figure — Memory bandwidth and latency metrics

Figure 5 — prerequisite map: bit → byte → width , and second → frequency → edges → data rate, all flowing into bandwidth; period + CL flowing into latency.


Equipment checklist

How many bits are in a byte?
8.
Convert 64 bits to bytes.
64 ÷ 8 = 8 bytes.
What does the bus width measure?
Bytes moved across the bus in one transfer.
What is 1 hertz?
One event (tick) per second.
What is the period in terms of frequency ?
— seconds per tick.
What does "nano" mean, and what is 60 ns in seconds?
nano = ; 60 ns = s.
What does "giga" mean?
(billion), as in GB/s.
Write "rate" as a formula.
rate = amount ÷ time (so amount = rate × time).
Why does DDR give a factor of 2?
Two clock edges (rising + falling) → 2 transfers per cycle.
If a clock is 1600 MHz, what is its DDR data rate?
3200 MT/s (2 × 1600).
Does adding channels change latency?
No — it only multiplies bandwidth.
What is CL (CAS Latency) a count of?
Clock cycles you wait before the first byte arrives.
What does measure and in what units?
The best-possible bandwidth, in bytes/s.
What does measure and in what units?
The wait for the first byte, a time in seconds.