ZeRO · Zero Redundancy Optimizer
A technique partitioning optimizer state, gradients and parameters across GPUs to remove memory redundancy in training.
Current numbers
$2.4MOwned fleet at time zero
September 3, 2026: conditional classification issuedERCOT Batch Zero conditional classification issued; service readiness remains project-specific
~0 L/kWhMicrosoft December 2024 zero-evaporation design: >125M L/year avoided cooling water per datacenter estimated; 2026 pilots and first operation in late 2027 were scheduled