H100
NVIDIA's Hopper-generation data-center GPU; the chip behind most of the 2023–2024 buildout wave and the baseline many density and power comparisons start from.
Current numbers
~40 → 600 kWper-rack power roadmap: H100 ~40 kW (2023), GB200 NVL72 ~132 kW nominal (2024), Kyber ~600 kW (2027)
80 → 288 GB → ~1 TBHBM capacity per accelerator package: H100 80 GB; HGX B200 180 GB; B300 288 GB (HBM3E); Rubin Ultra ~1 TB HBM4E on a four-chiplet package (roadmap)
$2.10–2.70/hrneocloud median H100 rental 2026; 1-yr contract index rose ~+40% Oct'25→Mar'26 — volatile, re-pull before committing