Marlin
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 5
- Tencent publishes NVFP4 WeMM-Video-35B-A3B checkpoint
Tencent published the WeMM-Video-35BA3B-NVFP4 checkpoint, an NVFP4 W4A16 Safetensors variant of WeMM-Video-35B-A3B with 24.11 GiB of weight files. The model card says it supports Chinese and English audio-visual understanding, accepting text, images, audio, and video, and includes instructions for serving it with patched vLLM 0.31.0, ModelOpt Mixed Precision, and Marlin.
腾讯混元 · Hugging Face · 🔥 4 - Tencent releases NVFP4-quantized WeMM-Video-9B checkpoint
Tencent published an NVFP4 W4A16 Safetensors variant of WeMM-Video-9B, with 13.07 GiB of weight files. The checkpoint accepts text, images, audio and video and generates Chinese or English responses, according to Tencent's Hugging Face repository; deployment uses patched vLLM 0.31.0 with ModelOpt Mixed Precision and Marlin.
腾讯混元 · Hugging Face · 🔥 4 - Tencent releases WeMM-Video-4B NVFP4 checkpoint
Tencent’s model repository publishes WeMM-Video-4B-NVFP4, an Apache 2.0-licensed NVFP4 W4A16 Safetensors derivative of WeMM-Video-4B with 7.42 GiB of weights. The bilingual video-text-to-text model accepts text, images, audio, and video, and the repository provides patched vLLM 0.31.0 serving instructions using ModelOpt Mixed Precision and Marlin, plus limited generation checks.
腾讯混元 · Hugging Face · 🔥 4 - Tencent releases NVFP4 WeMM-Video-2B checkpoint
Tencent published a Hugging Face repository for the NVFP4 W4A16 Safetensors variant of WeMM-Video-2B under the Apache 2.0 license. The checkpoint contains 4.90 GiB of weights and accepts text, images, audio, and video for Chinese or English text responses. Tencent documents deployment with patched vLLM 0.31.0 using ModelOpt Mixed Precision and Marlin.
腾讯混元 · Hugging Face · 🔥 4 - Humming 0.1.18 expands low-bit MoE integration in SGLang
Humming 0.1.18 expands the SGLang integration across more quantization schemes and GPU architectures, including Hopper and Blackwell. The project also introduced a shared activation-expression interface for SGLang's MoE runners. In its DeepSeek-V4.1-Flash-1017 evaluation on eight H20-3e GPUs, Humming A16 achieved project-reported prefill speedups of 1.07–1.23× over Marlin A16 at the same precision in the tested long-context cases. The report also covers FP8 expert activations, speculative-decoding acceptance and quality checks limited to the stated EP1 configurations.
LMSYS Blog · 🔥 0
Experience and discussion from the community
Share my Marlin experienceAsk about Marlin
Nobody has shared their experience with Marlin yet.