Time to first token
How long until the *first* word of a streamed response appears.
How long until the first word of a streamed response appears. The latency users actually feel. (Mod 3, 8, 9)
How long until the *first* word of a streamed response appears.
How long until the first word of a streamed response appears. The latency users actually feel. (Mod 3, 8, 9)