The Definitive Guide toAI Data Centers
Ask the GuideAboutAccount
Guide › Glossary › ZeRO

ZeRO · Zero Redundancy Optimizer

A technique partitioning optimizer state, gradients and parameters across GPUs to remove memory redundancy in training.

Current numbers

$2.4MOwned fleet at time zeroas of 2026-09-08 · register ↗
September 3, 2026: conditional classification issuedERCOT Batch Zero classification event; service readiness remains project-specificas of 2026-09-03 · register ↗
~10–30 kW typical; to ~50 kW on current productpassive RDHx capacity per rack (server fans only, zero added fan power)as of 2026-09 · register ↗

← All terms