Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

c/switchyard

Switchyard0 membersJoin discussion
Project infoNVIDIA-NeMo/Switchyard

About

Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.

Open sourceCreated November 17, 2026

Readme badge

Open-source project

Avatar from GitHubNVIDIA-NeMo/SwitchyardView on GitHub
Community-run · not official
Stars
3.6K
Forks
375
Language
Rust
License
Apache-2.0

Last commit Nov 17, 2026

Daily rank, last 30 days

Not on the daily list in the last 30 days

Switchyard: An open-source library that helps an AI agent choose which model handles each request.

What problem it solves AI agents need to choose among models while balancing task success, cost, and latency for their workloads. Applications also need flexibility in where routing runs and who controls model clients, credentials, retries, and service operation. Key features Multiple routing algorithms — Routing can be configured with Auto, Task, Execution, or Composite strategies, including mode…

github.comhttps://github.com/NVIDIA-NeMo/Switchyard