Humming 0.1.18
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Humming 0.1.18 expands low-bit MoE integration in SGLang
Humming 0.1.18 expands the SGLang integration across more quantization schemes and GPU architectures, including Hopper and Blackwell. The project also introduced a shared activation-expression interface for SGLang's MoE runners. In its DeepSeek-V4.1-Flash-1017 evaluation on eight H20-3e GPUs, Humming A16 achieved project-reported prefill speedups of 1.07–1.23× over Marlin A16 at the same precision in the tested long-context cases. The report also covers FP8 expert activations, speculative-decoding acceptance and quality checks limited to the stated EP1 configurations.
LMSYS Blog · 🔥 0
Experience and discussion from the community
Share my Humming 0.1.18 experienceAsk about Humming 0.1.18
Nobody has shared their experience with Humming 0.1.18 yet.