GPU:CPU ratio
The number of GPUs per CPU in a node; AI servers skew heavily toward GPUs, reshaping system balance.
Current numbers
~8:1 → ~2:1 and belowGPU:CPU ratio shifting from training-era norm toward agentic-inference host demand
2 : 1GPU:CPU ratio fixed by the GB200 NVL72 package (72 Blackwell GPUs : 36 Grace CPUs)