Scale-up
Tightly coupling GPUs into one coherent high-bandwidth domain (NVLink class) that acts like a single large accelerator.
Current numbers
8 - 72 - 576scale-up (NVLink) domain size: HGX node, NVL72 rack, announced Rubin Ultra Kyber
432 GBMI455X HBM4 @ ~19.6 TB/s per GPU; Helios = 72 GPUs, ~31 TB HBM4, ~260 TB/s scale-up, 2.9 EFLOPS FP4
512 XPUssingle-hop all-to-all scale-up domain on one Broadcom Tomahawk 6 (102.4 Tbps, SUE/ESUN)