Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

compressed-tensors

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 1

  1. Tencent releases WeMM-Video-4B AWQ W4A16 checkpoint

    Tencent published a 7.32 GiB AWQ W4A16 Safetensors checkpoint for WeMM-Video-4B. The language model’s feed-forward weights use group-128 INT4, while activations and attention weights remain BF16. The repository provides direct-loading instructions for Transformers 5.2.0 and a serving guide for patched vLLM 0.18.0 with the checkpoint’s compressed-tensors configuration; Transformers loading requires compressed-tensors 0.13.0. Tencent reports that the local checkpoint loaded and completed generation checks for text, images, audio, video frames and video with its soundtrack on one NVIDIA L20 using Transformers 5.2.0 and PyTorch 2.10.0+cu129.

    腾讯混元 · Hugging Face · 🔥 4

Experience and discussion from the community

Share my compressed-tensors experienceAsk about compressed-tensors

Nobody has shared their experience with compressed-tensors yet.