Tencent releases Hy4-base, a 771B multimodal MoE model
Tencent’s Hugging Face listing introduces Hy4-base as a 771B-parameter image-text-to-text model built on a 770B-parameter Mixture-of-Experts language backbone, with 49B parameters activated per token and a listed 1M-token context window. The model card says it supports text, image and video understanding, and provides Transformers support, GGUF weights, a finetuning pipeline, and deployment recipes for vLLM and SGLang. Tencent also reports benchmark and application improvements, but the supplied listing is the only source and its performance claims have not been independently verified.
Hy4-base is a substantial open-weight multimodal MoE release, combining large-scale language modeling, million-token context, vision and video inputs, speculative decoding, and production-oriented deployment resources in one model release.
tencent/Hy4-base Image-Text-to-Text • 771B • Updated about 3 hours ago • 2 • 5
license: other license_name: tencent-hy-license license_link: https://huggingface.co/tencent/Hy4-base/blob/main/LICENSE library_name: transformers pipeline_tag: image-text-to-text tags:
- hunyuan
- hy4
- moe
- multimodal
- pretrained
中文 | English
#Tencent#Hy4-base#DFly2#Transformers#vLLM#SGLang#AngelSlim#GGUF