TTFT · Time To First Token
How long an inference request waits before the first output token appears; a key latency SLO set by prefill.
Current numbers
up to ~77%goodput gain from hybrid aggregation/disaggregation over SOTA when both TTFT and TPOT bind