Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Marlin

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 5

  1. Tencent publishes NVFP4 WeMM-Video-35B-A3B checkpoint

    Tencent published the WeMM-Video-35BA3B-NVFP4 checkpoint, an NVFP4 W4A16 Safetensors variant of WeMM-Video-35B-A3B with 24.11 GiB of weight files. The model card says it supports Chinese and English audio-visual understanding, accepting text, images, audio, and video, and includes instructions for serving it with patched vLLM 0.31.0, ModelOpt Mixed Precision, and Marlin.

    腾讯混元 · Hugging Face · 🔥 4
  2. Tencent releases NVFP4-quantized WeMM-Video-9B checkpoint

    Tencent published an NVFP4 W4A16 Safetensors variant of WeMM-Video-9B, with 13.07 GiB of weight files. The checkpoint accepts text, images, audio and video and generates Chinese or English responses, according to Tencent's Hugging Face repository; deployment uses patched vLLM 0.31.0 with ModelOpt Mixed Precision and Marlin.

    腾讯混元 · Hugging Face · 🔥 4
  3. Tencent releases WeMM-Video-4B NVFP4 checkpoint

    Tencent’s model repository publishes WeMM-Video-4B-NVFP4, an Apache 2.0-licensed NVFP4 W4A16 Safetensors derivative of WeMM-Video-4B with 7.42 GiB of weights. The bilingual video-text-to-text model accepts text, images, audio, and video, and the repository provides patched vLLM 0.31.0 serving instructions using ModelOpt Mixed Precision and Marlin, plus limited generation checks.

    腾讯混元 · Hugging Face · 🔥 4
  4. Tencent releases NVFP4 WeMM-Video-2B checkpoint

    Tencent published a Hugging Face repository for the NVFP4 W4A16 Safetensors variant of WeMM-Video-2B under the Apache 2.0 license. The checkpoint contains 4.90 GiB of weights and accepts text, images, audio, and video for Chinese or English text responses. Tencent documents deployment with patched vLLM 0.31.0 using ModelOpt Mixed Precision and Marlin.

    腾讯混元 · Hugging Face · 🔥 4
  5. Humming 0.1.18 expands low-bit MoE integration in SGLang

    Humming 0.1.18 expands the SGLang integration across more quantization schemes and GPU architectures, including Hopper and Blackwell. The project also introduced a shared activation-expression interface for SGLang's MoE runners. In its DeepSeek-V4.1-Flash-1017 evaluation on eight H20-3e GPUs, Humming A16 achieved project-reported prefill speedups of 1.07–1.23× over Marlin A16 at the same precision in the tested long-context cases. The report also covers FP8 expert activations, speculative-decoding acceptance and quality checks limited to the stated EP1 configurations.

    LMSYS Blog · 🔥 0

Experience and discussion from the community

Share my Marlin experienceAsk about Marlin

Nobody has shared their experience with Marlin yet.