The Definitive Guide toAI Data Centers
Ask the GuideAboutAccount
Guide › Glossary › Oversubscription

Oversubscription

Provisioning less network bandwidth than full non-blocking would require; 1:1 is non-blocking, 3:1 is oversubscribed.

Current numbers

~3% training / ~21% inferencepower-budget headroom oversubscription, training vs inference fleetsas of 2024-04 · register ↗
~21% vs ~3%power-oversubscription headroom: inference (uncorrelated per-request peaks) vs training (synchronous peaks)as of 2024 · register ↗
~31%back-end fabric cost avoided with 2:1 oversubscription (virtual-modular-switch design) vs the non-oversubscribed reference — where the workload allows (contested — single-source)as of 2024 · register ↗

← All terms