OpenAI-compatible API
A de-facto standard API shape most engines (including vLLM) support, so clients can switch backends easily.
A de-facto standard API shape most engines (including vLLM) support, so clients can switch backends easily.
A de-facto standard API shape most engines (including vLLM) support, so clients can switch backends easily.
A de-facto standard API shape most engines (including vLLM) support, so clients can switch backends easily.