semantic-router: An open, programmable decision layer for models and compute.
What problem it solves Agent harnesses need to coordinate models, tools, task state, and changing compute requirements without manually managing every backend. They also need a way to apply location constraints and priorities for quality, latency, and cost to each call. Key features Policy-driven model routing — Select or combine models for each call according to a configured policy while leaving …
github.comhttps://github.com/vllm-project/semantic-router