Gateway / proxy
A single chokepoint all model calls pass through, used to centralize caching, routing, rate limits, budgets, and logging.
A single chokepoint all model calls pass through, used to centralize caching, routing, rate limits, budgets, and logging. (Mod 1, 5)