The Definitive Guide toAI Data Centers
Ask the GuideAboutAccount
Guide › Glossary › Memory-bandwidth-bound

Memory-bandwidth-bound

A workload limited by how fast data moves from memory rather than by compute; typical of inference decode.

Related terms: Decode · Decode · SM

Where the guide uses this

7.10
Precision, Quantization & the Compute-Memory Tradeoff
8.2
Scale-Up Fabric (Intra-Node / Intra-Rack)
16.3
Software, Orchestration & Efficiency at the Frontier
10.11
Inference Serving Engineering: SLOs, Batching, Disaggregation & Goodput-Optimal Scheduling
1.3
Inference Data Centers: Bursty, Distributed, Always-On
7.2
NVIDIA Accelerators: Hopper → Blackwell → Vera Rubin → Rubin Ultra → Feynman

← All terms