The Definitive Guide toAI Data Centers
Ask the GuideAboutAccount
Guide › Glossary › FP4

FP4

A 4-bit floating-point format, native in Blackwell-class silicon, pushing inference throughput and density further.

Current numbers

~2.9 EF FP4AMD Helios (72× MI455X) rack-scale FP4 (1.4 EF FP8), 31 TB HBM4, ORW double-wideas of 2026-09 · register ↗
1st rack validated 2026-06-01CoreWeave industry-first Vera Rubin NVL72 bring-up (Jun 1 2026, Livingston NJ; Dell-integrated) — 72 Rubin GPUs + 36 Vera CPUs, ~3.6 EFLOPS FP4, 260 TB/s NVLink 6; a single validated rack, not fleet GAas of 2026-06 · register ↗
216 GBHBM3E per Microsoft Maia 200 @ 7 TB/s; >10 PFLOPS FP4 / 5 PFLOPS FP8, 750W, +30% perf/$as of early 2026 · register ↗

← All terms