BerriAI

Headlines · 1

1. Oct 10
   LiteLLM open-source AI gateway trends on GitHub

   GitHub Trending's daily list features BerriAI's LiteLLM, an open-source AI gateway that offers a single interface for calling 100+ LLM providers — including OpenAI, Anthropic, Gemini, Bedrock, Azure, Vertex AI, vLLM and Nvidia NIM — in OpenAI format. It runs either as a Python SDK or as a self-hosted proxy server with virtual keys, spend tracking, guardrails, load balancing and logging; the repo cites an 8ms P95 latency benchmark at 1k RPS and lists Netflix as an open-source adopter. The README also covers an MCP gateway, A2A agent invocation, and running harnesses such as Claude Code, Codex and OpenCode on any model.

   GitHub Trending（每日） · 🔥 0

Experience and discussion from the community

Share my BerriAI experienceAsk about BerriAI