Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Tencent releases Hy4-base, a 771B multimodal MoE model

AI summary

Tencent’s Hugging Face listing introduces Hy4-base as a 771B-parameter image-text-to-text model built on a 770B-parameter Mixture-of-Experts language backbone, with 49B parameters activated per token and a listed 1M-token context window. The model card says it supports text, image and video understanding, and provides Transformers support, GGUF weights, a finetuning pipeline, and deployment recipes for vLLM and SGLang. Tencent also reports benchmark and application improvements, but the supplied listing is the only source and its performance claims have not been independently verified.

In-depth insight

Hy4-base is a substantial open-weight multimodal MoE release, combining large-scale language modeling, million-token context, vision and video inputs, speculative decoding, and production-oriented deployment resources in one model release.

tencent/Hy4-base Image-Text-to-Text • 771B • Updated about 3 hours ago • 2 • 5


license: other license_name: tencent-hy-license license_link: https://huggingface.co/tencent/Hy4-base/blob/main/LICENSE library_name: transformers pipeline_tag: image-text-to-text tags:

  • hunyuan
  • hy4
  • moe
  • multimodal
  • pretrained

中文 | English

#Tencent#Hy4-base#DFly2#Transformers#vLLM#SGLang#AngelSlim#GGUF

Original · 8 min readRead the original
Group chat

No comments yet. Start the conversation.