Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

llama.cpp adds support for Xing4.0-29B-A4B and a GGUF release appears

AI summary

A pull request to llama.cpp adds support for Xing4.0-29B-A4B, a 29B-total-parameter MoE model with 4B parameters activated per token. A follow-up report points to a Hugging Face GGUF release, while the model description claims 256K native context, Ascend training, agent-oriented features and roughly 96% higher training throughput, but these details have not been independently verified.

In-depth insight

The reported llama.cpp integration and GGUF release could make the new MoE model available for local deployment, although implementation quality and vendor benchmark claims remain unverified.

Xing4.0-29B-A4B is a next-generation large language model in the Xing series (formerly TeleChat), developed by China Telecom Artificial Intelligence Technology Co., Ltd. With 29B total parameters and only 4B activated per token, it natively supports a 256K context length, extensible to 512K. It is the first model of this scale trained entirely on the Ascend NPU platform with the MindSpore framework, and deeply optimized for complex engineering tasks. For more information, please refer to our GitHub repository. Highlights submitted by /u/jacek2023 [link] [comments]

#Xing4.0-29B-A4B#llama.cpp#China Telecom Artificial Intelligence Technology Co., Ltd.#MindSpore#MindFormers#Ascend 910C#Hugging Face#XingChen-AGI_Xing4.0-29B-A4B-GGUF

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.