NUMA · non-uniform memory access
The property that a CPU socket reaches some memory and devices faster than others; misaligned GPU-NIC-socket affinity silently drags down collective performance across an entire job.
The property that a CPU socket reaches some memory and devices faster than others; misaligned GPU-NIC-socket affinity silently drags down collective performance across an entire job.