vLLM ships day-0 support for Meta's Muse Spark Open 816B open-weight MoE model
vLLM said it worked with Meta Superintelligence Labs to bring day-0 serving support to Muse Spark Open, an open-weight sparse mixture-of-experts model. According to the vLLM blog, the model has 816B total parameters with 42B active per token and a 1M-token context window, ships in BF16 and NVFP4 (AMD released MXFP4 weights), and handles image, video and audio input through the same Perception Encoder used by Muse Glimmer. vLLM also offers a DSpark speculative-decoding draft model trained by Inferact, support on NVIDIA, AMD Instinct MI355X and TPU, and a LoRA reinforcement-learning recipe that lifted AIME-2024 (mean@8) from 0.56 to 0.85 after 150 GRPO steps on 16 GB300 GPUs.
Day-0 inference and RL support lowers the barrier for developers to try this large open-weight model.