Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

SGLang and Miles add day-0 support for Muse Spark Open

AI summary

An LMSYS blog post says SGLang and Miles have added day-0 support for Muse Spark Open, an open-weight multimodal mixture-of-experts model. Its text backbone has 816B parameters with roughly 42B active parameters per token, accepts text, image, video and audio inputs, supports a 1M-token context window, and ships NVFP4 and BF16 checkpoints. The SGLang integration adds sequence parallelism with NVFP4 MegaMoE for prefill, multimodal preprocessing optimizations and DFlash V2 speculative decoding; the team reports that on 8 NVIDIA B300 GPUs with the NVFP4 checkpoint, an OpenHands multi-turn agentic coding replay reaches 14.8K total tokens/sec per GPU at concurrency 1 and 80.3K at concurrency 128.

In-depth insight

For newly released open-weight models, getting fast day-one support in mainstream inference stacks increasingly shapes how quickly developers can actually adopt them.

Muse Spark OpenSGLangMiles

Original · 19 min readRead the original
Group chat

No comments yet. Start the conversation.