The Definitive Guide toAI Data Centers
Ask the GuideAboutAccount
Guide › Glossary › Optimizer state

Optimizer state

The extra per-parameter data an optimizer like Adam keeps (momentum, variance), often doubling or tripling memory needs.

Related terms: Checkpoint · FSDP · ZeRO

Where the guide uses this

13.9
Cluster-Scale Benchmarking, Reference Training & Storage/Scheduler Validation
1.4
Post-Training, Fine-Tuning & RL: The Hybrid Middle
9.4
Checkpointing for Large-Scale Training
10.8
MLOps & Training Frameworks
9.1
Storage in the AI Lifecycle: Why It Determines GPU Efficiency
10.6
Observability, Telemetry & GPU Health

← All terms