Mozilla AI open-sources Otari, a self-hosted LLM gateway
The otari project from Mozilla AI appeared on GitHub's Python trending list: a self-run, OpenAI- and Anthropic-compatible LLM gateway that routes one endpoint to more than 40 model providers, per its documentation. Otari sits between applications and providers, authenticating requests, resolving provider credentials, checking budgets before dispatch and recording usage after settlement, with provider calls going through any-llm. It also offers revocable virtual keys scoped to users, workspaces and models, plus local routing policies for failover and weighting, and is released under Apache 2.0.
According to the project's documentation, Otari keeps provider credentials behind a gateway the team runs itself while enforcing virtual keys and budgets — the kind of control organizations want when calling many model providers.
Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.
An OpenAI-compatible LLM gateway you own and run.