The Definitive Guide toAI Data Centers
Ask the GuideAboutAccount
Guide › Numbers register › Claim

MI300X cost-per-token advantage vs H100 SXM in small-batch / largest-model inference regimes

~20%observed

Value kindobserved — Reported measurements, counts, and specifications keep the precision and scope stated by their source; an exact specification is not treated as a range.
As of2025
SourceSemiAnalysis inference benchmark (cost/Mtoken)
Reviewchecking…review by 2026-08-25 · fast cadence
Recorded changeslast 2026-06-29
Claim idmi300x-cost-per-token-advantage-vs-h100-sxm-in

Where the guide uses it

← Full numbers register — every date-stamped figure in the guide, with revision history.