The Definitive Guide toAI Data Centers
Ask the GuideAboutAccount
Guide › Glossary › FP16

FP16 · 16-bit floating point

A half-precision number format; it is the usual reference rung of the precision ladder, since each step down from it roughly doubles a chip's headline throughput.

Current numbers

~$1.90/M tokself-hosted inference (8x H100 @ ~$19.20/hr, Llama-70B FP16); market avg fell ~$10 → ~$2.50/M in a yearas of 2025 · register ↗

← All terms