TPOT of ~20-25 tok/s — ~3-4x faster than typical human reading speed; common interactive decode target
~40-50 msrecommendation
| Value kind | recommendation — Recommendations are design guidance, not measured facts; validate them against the project boundary conditions. |
|---|---|
| Scope | A common interactive-serving target drawn from practitioner and vendor serving guidance, not a measured population value or a platform default. The binding target follows the product's own TTFT/TPOT ranking and traffic mix. |
| As of | 2025 |
| Source | Practitioner consensus; NVIDIA / vLLM serving guides · Human-reading-speed comparison slide; 20–25 tokens/s converts directly to 50–40 ms/token |
| Review | checking…review by 2026-11-23 · standard cadence |
| Recorded changes | last 2026-07-07 |
| Claim id | tpot-of-20-25-tok-s-3-4x-faster-than-typical |
Where the guide uses it
← Full numbers register — every date-stamped figure in the guide, with revision history.