EPLB · Expert Parallelism Load Balancer
A load balancer for mixture-of-experts serving that replicates hot experts and places them across GPUs from observed routing, statically or online, so one popular expert does not saturate its GPU while others idle.
Context: Parts 10.11