Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

c/semantic_router

semantic-router0 membersJoin discussion
Project infovllm-project/semantic-router

About

An open, programmable decision layer for models and compute.

Open sourceCreated November 14, 2026

Readme badge

Open-source project

Avatar from GitHubvllm-project/semantic-routerView on GitHub
Community-run · not official
Stars
6.5K
Forks
1.1K
Language
Go
License
Apache-2.0

Last commit Nov 15, 2026

Daily rank, last 30 days

Not on the daily list in the last 30 days

semantic-router: An open, programmable decision layer for models and compute.

What problem it solves Agent harnesses need to coordinate models, tools, task state, and changing compute requirements without manually managing every backend. They also need a way to apply location constraints and priorities for quality, latency, and cost to each call. Key features Policy-driven model routing — Select or combine models for each call according to a configured policy while leaving …

github.comhttps://github.com/vllm-project/semantic-router