self-hosted inference (8x H100 @ ~$19.20/hr, Llama-70B FP16); market avg fell ~$10 → ~$2.50/M in a year
~$1.90/M tokobserved
| Value kind | observed — Reported measurements, counts, and specifications keep the precision and scope stated by their source; an exact specification is not treated as a range. |
|---|---|
| As of | 2025 |
| Source | Spheron |
| Review | checking…review by 2026-08-25 · fast cadence |
| Recorded changes | last 2026-07-14 · 4 revisions tracked |
| Claim id | self-hosted-inference-8x-h100-19-20-hr-llama |
Where the guide uses it
← Full numbers register — every date-stamped figure in the guide, with revision history.