The Definitive Guide toAI Data Centers
Ask the Guide
GuideGlossaryDecode

Decode

The memory-bandwidth-bound phase that generates output tokens one at a time after prefill.

← All terms