FineWeb corpus from 96 Common Crawl snapshots (~44 TB on disk as GPT-2 tokens)
15T tokensobserved
| Value kind | observed — Reported measurements, counts, and specifications keep the precision and scope stated by their source; an exact specification is not treated as a range. |
|---|---|
| As of | 2024 |
| Source | FineWeb paper (Penedo et al.), HuggingFace · Introduction and final-dataset summary: 15T tokens, 44 TB disk space, 96 Common Crawl snapshots, GPT-2 tokenizer |
| Review | checking…review by 2026-10-24 · standard cadence |
| Recorded changes | last 2026-06-29 |
| Claim id | fineweb-corpus-from-96-common-crawl-snapshots |
Where the guide uses it
← Full numbers register — every date-stamped figure in the guide, with revision history.