Rolling / blue-green / canary deployment

Appears in 1 tutorial

Update strategies: replace replicas gradually / run new alongside old then switch / send a small traffic slice to the new version first.

As used in LLM Infrastructure →

Update strategies: replace replicas gradually / run new alongside old then switch / send a small traffic slice to the new version first. Canary is vital for LLMs because new models can change output quality.