The Definitive Guide toAI Data Centers
Ask the GuideAboutAccount
Guide › Numbers register › Claim

Demonstrated downstream-performance-preserving compression reaches approximately 1.15 bit/parameter; an exploratory Llama-3-70B weight-space result suggests approximately 0.1 bit/parameter

~1.15 bit/param demonstrated; 0.1 bit/param exploratoryobserved

Value kindobserved — Reported measurements, counts, and specifications keep the precision and scope stated by their source; an exact specification is not treated as a range.
ScopeThe 0.1-bit result measures weight-space MSE and was not subjected to full downstream evaluation; it should not be presented as an experimentally validated functional-model floor.
As of2026-01-03
SourceBrown, Rivera, Hendrycks and Mazeika, Aggressive Compression Enables LLM Weight Theft · Section 4.2, especially results paragraph; Appendix Figure 10 and caption
Reviewchecking…review by 2026-10-13 · standard cadence
Recorded changeslast 2026-07-14 · 3 revisions tracked
Claim idpreliminary-feasible-weight-compression-floor

Where the guide uses it

← Full numbers register — every date-stamped figure in the guide, with revision history.