GPU:CPU ratio
The number of GPUs per CPU in a node; AI servers skew heavily toward GPUs, reshaping system balance.
Current numbers
~8:1 → ~2:1 and belowGPU:CPU ratio shifting from training-era norm toward agentic-inference host demand
2:1–1:1agentic-era GPU:CPU ratio, down from the training-era 4:1–8:1 (Intel: 8:1 → 1:1)
2 : 1GPU:CPU ratio fixed by the GB200 NVL72 package (72 Blackwell GPUs : 36 Grace CPUs)