Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

FlashInfer 0.7.2

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 1

  1. Humming 0.1.18 expands low-bit MoE integration in SGLang

    Humming 0.1.18 expands the SGLang integration across more quantization schemes and GPU architectures, including Hopper and Blackwell. The project also introduced a shared activation-expression interface for SGLang's MoE runners. In its DeepSeek-V4.1-Flash-1017 evaluation on eight H20-3e GPUs, Humming A16 achieved project-reported prefill speedups of 1.07–1.23× over Marlin A16 at the same precision in the tested long-context cases. The report also covers FP8 expert activations, speculative-decoding acceptance and quality checks limited to the stated EP1 configurations.

    LMSYS Blog · 🔥 0

Experience and discussion from the community

Share my FlashInfer 0.7.2 experienceAsk about FlashInfer 0.7.2

Nobody has shared their experience with FlashInfer 0.7.2 yet.