ZeRO · Zero Redundancy Optimizer
A technique partitioning optimizer state, gradients and parameters across GPUs to remove memory redundancy in training.
Current numbers
800 Gb/sBlueField-4 DPU throughput; 64 Arm cores, ~6x BlueField-3 compute; zero-trust east-west enforcement at line rate
SP 800-207NIST Zero Trust Architecture — 'never trust, always verify'; no trust from network location
~10–30 kW typical; to ~50 kW on current productpassive RDHx capacity per rack (server fans only, zero added fan power)