Meta Llama 3 405B pre-training: six interruptions attributed to silent data corruption in the reported 54-day campaign
6 SDC interruptions / 54-day campaignobserved
| Value kind | observed — Reported measurements, counts, and specifications keep the precision and scope stated by their source; an exact specification is not treated as a range. |
|---|---|
| Scope | Named campaign and recorded interruption category. Not a complete count of silent errors, a per-device defect probability or a portable recurrence interval; the fault/device statement in Meta’s July 2025 discussion has a separate measurement boundary. |
| As of | 2024-07 |
| Source | Meta, The Llama 3 Herd of Models, July 2024 report, §3.3.4 and Table 5 (read in arXiv v3, 23 November 2024). · Table 5: Silent Data Corruption, GPU, 6 interruptions; 54-day Llama 3 405B pre-training period on 16,384 H100 GPUs. |
| Review | checking…review by 2027-03-08 · standard cadence |
| Recorded changes | none recorded |
| Claim id | llama-3-405b-sdc-interruptions-54-day-campaign |
Where the guide uses it
Not quoted in a chapter yet; it is kept in the curated register.
← Full numbers register — every date-stamped figure in the guide, with revision history.