Otari

Headlines · 1

1. 21h
   Mozilla AI open-sources Otari, a self-hosted LLM gateway

   The otari project from Mozilla AI appeared on GitHub's Python trending list: a self-run, OpenAI- and Anthropic-compatible LLM gateway that routes one endpoint to more than 40 model providers, per its documentation. Otari sits between applications and providers, authenticating requests, resolving provider credentials, checking budgets before dispatch and recording usage after settlement, with provider calls going through any-llm. It also offers revocable virtual keys scoped to users, workspaces and models, plus local routing policies for failover and weighting, and is released under Apache 2.0.

   GitHub Trending · Python · 🔥 6

Experience and discussion from the community

Share my Otari experienceAsk about Otari