Pretraining
The initial, compute-heavy phase that trains a model on vast unlabeled data to learn general capabilities.
Current numbers
6–21%ClusterMAX April 2026 large-pretraining model: rounded goodput-expense range across provider profiles
6.14 / 10.53 / 20.91%ClusterMAX April 2026 large-pretraining scenario: gold / hyperscaler / silver goodput expense