A collective that assembles each GPU's data shard onto every GPU, common in sharded training and inference.
← All terms