Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

ModelOpt

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 2

  1. Tencent publishes NVFP4 WeMM-Video-35B-A3B checkpoint

    Tencent published the WeMM-Video-35BA3B-NVFP4 checkpoint, an NVFP4 W4A16 Safetensors variant of WeMM-Video-35B-A3B with 24.11 GiB of weight files. The model card says it supports Chinese and English audio-visual understanding, accepting text, images, audio, and video, and includes instructions for serving it with patched vLLM 0.31.0, ModelOpt Mixed Precision, and Marlin.

    腾讯混元 · Hugging Face · 🔥 4
  2. Tencent releases NVFP4-quantized WeMM-Video-9B checkpoint

    Tencent published an NVFP4 W4A16 Safetensors variant of WeMM-Video-9B, with 13.07 GiB of weight files. The checkpoint accepts text, images, audio and video and generates Chinese or English responses, according to Tencent's Hugging Face repository; deployment uses patched vLLM 0.31.0 with ModelOpt Mixed Precision and Marlin.

    腾讯混元 · Hugging Face · 🔥 4

Experience and discussion from the community

Share my ModelOpt experienceAsk about ModelOpt

Model-Optimizer: A library for composing model optimization techniques and exporting optimized quantized checkpoints.

What problem it solves Deep learning models often need to be adapted for efficient deployment across different inference frameworks. Model Optimizer addresses this by providing a unified set of optimization techniques and export workflows for quantized checkpoints. Key features Post-training quantization — Compress models with quantization techniques available for Hugging Face, Megatron-Bridge, Di…

github.comhttps://github.com/NVIDIA/Model-Optimizer