LiteLLM open-source AI gateway trends on GitHub
GitHub Trending's daily list features BerriAI's LiteLLM, an open-source AI gateway that offers a single interface for calling 100+ LLM providers — including OpenAI, Anthropic, Gemini, Bedrock, Azure, Vertex AI, vLLM and Nvidia NIM — in OpenAI format. It runs either as a Python SDK or as a self-hosted proxy server with virtual keys, spend tracking, guardrails, load balancing and logging; the repo cites an 8ms P95 latency benchmark at 1k RPS and lists Netflix as an open-source adopter. The README also covers an MCP gateway, A2A agent invocation, and running harnesses such as Claude Code, Codex and OpenCode on any model.
For teams juggling multiple model providers while needing unified billing and controls, gateways like this are becoming a common middle layer.
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
🚅 LiteLLM
LiteLLM AI Gateway
Some source content is omitted. Continue reading on the original site.