The aggregate bandwidth across the worst-case cut of a network; the key figure for all-reduce-heavy training.
Related terms: All-reduce
← All terms