The Definitive Guide toAI Data Centers
Ask the GuideAboutAccount
Guide › Numbers register › Claim

typical contiguous-span threshold for n-gram benchmark decontamination overlap matching

8–13-gramobserved

Value kindobserved — Reported measurements, counts, and specifications keep the precision and scope stated by their source; an exact specification is not treated as a range.
As of2025
SourceOpenAI/Llama/Dolma decontamination practice · Appendix A, pages 17–18; documents Meta's 8-gram method and Qwen2's 13-gram exclusion method
Reviewchecking…review by 2026-09-12 · standard cadence
Recorded changeslast 2026-06-29
Claim idtypical-contiguous-span-threshold-for-n-gram

Where the guide uses it

← Full numbers register — every date-stamped figure in the guide, with revision history.