Streaming

Showing the answer as it's generated, word by word, to slash perceived latency. The signature AI UX pattern. (Mod 8, 9)

Sending output tokens to the client as they're generated (the decode loop made visible).