The Definitive Guide toAI Data Centers
Ask the GuideAboutAccount
GuideGlossaryROCm

ROCm

AMD's open GPU-computing software stack, its counterpart to NVIDIA's CUDA ecosystem.

Current numbers

~40%MI355X (ROCm/SGLang FP8) cost-per-Mtoken advantage vs B200 (SGLang) at points on the GLM-5 single-node frontier — gap reversed on funded workloadsas of 2026 · register ↗
~15–30%lower hardware cost for AMD vs NVIDIA — the prize that funds the ROCm taxas of 2025-2026 · register ↗
37–66%MI300X realized inference performance vs H100/H200 despite ~1.3x paper FLOPS — the ROCm goodput gapas of 2025 · register ↗

← All terms