vLLM Semantic Router open-sources Decision 3.0 decision models, tops decision leaderboard
The vLLM community project vLLM Semantic Router released and open-sourced the Decision 3.0 family of multimodal decision models: d3, d3-flash, d3-mini, d3-nano, d3-lite and d3-edge, spanning roughly 0.6B to 27B parameters, with weights published on Hugging Face. The flagship d3 is built on Qwen3.8-27B and accepts multiple images and video, while the other five are based on Qwen3.5 at different sizes; unlike Jev, which is served mainly via cloud API, the series is open-weight and locally deployable. According to team-provided figures, on the Jev Decision Index 0.3.1 leaderboard d3 ranks first with a text decision index of 64.7 and a vision score of 71.6, ahead of Jev's 60.1 and Microsoft Decision-1's 53.2 (9B, fine-tuned from Qwen3.5-9B); the team also reports median latency on a single AMD Instinct MI325X GPU of 55 ms for text, 273 ms with images and 553 ms for 10-second video, while one developer ran d3-lite via Core ML on an M5 Pro Mac to classify and route 1,000 pull requests in about two minutes.
Small decision models can handle intent detection, classification and model routing, offloading simple tasks from general LLMs and helping multi-model systems cut inference cost and improve response speed.
智东西 编译 | 杨京丽 编辑 | 李水青
智东西10月12日消息，昨天，vLLM社区孵化的开源AI基础设施项目vLLM Semantic Router推出并开源多模态决策模型Decision 3.0系列。该系列模型能够根据输入内容完成分类、选择、是非判断和评分等任务，直接返回判断结果和概率，不生成长篇文本。
▲vLLM Semantic Router推出并开源Decision 3.0（图源：X）
这类不生成长文本，专门“做判断”的模型，近期因Jev走红而受到关注。Jev模型上线仅3天，其Token用量便达到1万亿；上线仅24天，其开发商TypeSafe AI便宣布获得a16z领投的8.7亿美元（约合人民币58亿元）融资，估值达到75亿美元（约合人民币502亿元）。
#vLLM Semantic Router#Decision 3.0#d3#Jev#TypeSafe AI#a16z#Microsoft#Microsoft-Decision-1#Qwen#Hugging Face#AMD Instinct MI325X#Core ML