Switchyard: An open-source library that helps an AI agent choose which model handles each request.
What problem it solves AI agents need to choose among models while balancing task success, cost, and latency for their workloads. Applications also need flexibility in where routing runs and who controls model clients, credentials, retries, and service operation. Key features Multiple routing algorithms — Routing can be configured with Auto, Task, Execution, or Composite strategies, including mode…
github.comhttps://github.com/NVIDIA-NeMo/Switchyard