network share of Llama 3 405B unexpected interruptions — Network Switch/Cable 35 of 419 (8.4%, the only network row Meta publishes); adding the 7 NIC cases gives 42/419 = 10.0%, an editorial aggregation, not a Meta-published metric
8.4% (10.0% incl. NIC)observed
| Value kind | observed — Reported measurements, counts, and specifications keep the precision and scope stated by their source; an exact specification is not treated as a range. |
|---|---|
| Caveat | Table 5 is internally inconsistent: its 17 listed counts sum to 417 although §3.3.4 states 419 unexpected interruptions; printed percentages sum to 94.4%; and 148/419 = 35.3%, not the printed 30.1%. Treat counts as auditable; label percentages as paper-printed. Network Switch/Cable is 35 (8.4% printed); NIC is classified Host and NCCL watchdog timeouts Unknown. |
| As of | 2024-07 |
| Source | Meta AI, The Llama 3 Herd of Models, §3.3.4/Table 5 · §3.3.4, Table 5: 466 total interruptions, 47 planned, 419 unexpected; rows for faulty GPU, HBM3, software, network, and the remaining categories |
| Review | checking…review by 2026-12-22 · standard cadence |
| Recorded changes | last 2026-08-24 · 3 revisions tracked |
| Claim id | network-share-of-llama-3-training-interruptions |
Where the guide uses it
- 8.1 Network Fundamentals & AI Traffic Characterization
- 8.4 Scale-Out Fabric: Protocols, Standards & Transport
- 8.5 Scale-Out Topology, Sizing & Oversubscription
- 8.6 Congestion Control, Load Balancing & In-Network Compute
- 10.2 Topology-Aware & Rack-Scale Scheduling
← Full numbers register — every date-stamped figure in the guide, with revision history.