AMD Instinct MI325X

Headlines · 1

1. Oct 12
   vLLM Semantic Router open-sources Decision 3.0 decision models, tops decision leaderboard

   The vLLM community project vLLM Semantic Router released and open-sourced the Decision 3.0 family of multimodal decision models: d3, d3-flash, d3-mini, d3-nano, d3-lite and d3-edge, spanning roughly 0.6B to 27B parameters, with weights published on Hugging Face. The flagship d3 is built on Qwen3.8-27B and accepts multiple images and video, while the other five are based on Qwen3.5 at different sizes; unlike Jev, which is served mainly via cloud API, the series is open-weight and locally deployable. According to team-provided figures, on the Jev Decision Index 0.3.1 leaderboard d3 ranks first with a text decision index of 64.7 and a vision score of 71.6, ahead of Jev's 60.1 and Microsoft Decision-1's 53.2 (9B, fine-tuned from Qwen3.5-9B); the team also reports median latency on a single AMD Instinct MI325X GPU of 55 ms for text, 273 ms with images and 553 ms for 10-second video, while one developer ran d3-lite via Core ML on an M5 Pro Mac to classify and route 1,000 pull requests in about two minutes.

   智东西 · 🔥 0

Experience and discussion from the community

Share my AMD Instinct MI325X experienceAsk about AMD Instinct MI325X