HGX
NVIDIA's baseboard reference platform integrating 8 GPUs with NVLink, the building block for many AI servers.
Current numbers
80 → 288 GB → ~1 TBHBM capacity per accelerator package: H100 80 GB; HGX B200 180 GB; B300 288 GB (HBM3E); Rubin Ultra ~1 TB HBM4E on a four-chiplet package (roadmap)
~288 GBHBM4 per Rubin GPU at ~22 TB/s; trajectory H100 80 GB → H200 141 GB → HGX B200 180 GB → B300 288 GB, flat into Rubin, then Rubin Ultra 1 TB
HGX 8; NVL72 72; Rubin Ultra NVL576 576/8 racks; Kyber NVL144 144/rack, NVL1152 1,152/8 racksscale-up (NVLink) domain size: HGX node, NVL72 rack, announced Rubin Ultra Kyber