GPU utilization: naive CSV/small-file loading vs sharded WebDataset/TFRecord + DALI; shard sweet spot ~100 MB–1 GB
< 50% vs > 90%observed
| Value kind | observed — Reported measurements, counts, and specifications keep the precision and scope stated by their source; an exact specification is not treated as a range. |
|---|---|
| As of | 2025 |
| Source | AWS |
| Review | checking…review by 2026-09-28 · fast cadence |
| Recorded changes | last 2026-08-24 · 2 revisions tracked |
| Claim id | gpu-utilization-naive-csv-small-file-loading-vs |
Where the guide uses it
← Full numbers register — every date-stamped figure in the guide, with revision history.