The Definitive Guide toAI Data Centers
Ask the GuideAboutAccount
GuideGlossaryCollective

Collective

A coordinated communication pattern across many GPUs (all-reduce, all-gather, reduce-scatter) central to distributed AI.

Current numbers

~95%Spectrum-X / tuned-RoCE effective throughput vs raw link rate under collective load; untuned RoCE can collapse to ~60%as of 2025 · register ↗

← All terms