Liveness vs readiness probe
Health checks: "is it alive?" (restart if not) vs "is it ready to serve?" (don't route traffic until the model is loaded — crucial for slow-loading LLMs).
Health checks: "is it alive?" (restart if not) vs "is it ready to serve?" (don't route traffic until the model is loaded — crucial for slow-loading LLMs).