llama.cpp adds support for Xing4.0-29B-A4B and a GGUF release appears
A pull request to llama.cpp adds support for Xing4.0-29B-A4B, a 29B-total-parameter MoE model with 4B parameters activated per token. A follow-up report points to a Hugging Face GGUF release, while the model description claims 256K native context, Ascend training, agent-oriented features and roughly 96% higher training throughput, but these details have not been independently verified.
The reported llama.cpp integration and GGUF release could make the new MoE model available for local deployment, although implementation quality and vendor benchmark claims remain unverified.
| Xing4.0-29B-A4B is a next-generation large language model in the Xing series (formerly TeleChat), developed by China Telecom Artificial Intelligence Technology Co., Ltd. With 29B total parameters and only 4B activated per token, it natively supports a 256K context length, extensible to 512K. It is the first model of this scale trained entirely on the Ascend NPU platform with the MindSpore framework, and deeply optimized for complex engineering tasks. For more information, please refer to our GitHub repository. Highlights submitted by /u/jacek2023 [link] [comments] |
#Xing4.0-29B-A4B#llama.cpp#China Telecom Artificial Intelligence Technology Co., Ltd.#MindSpore#MindFormers#Ascend 910C#Hugging Face#XingChen-AGI_Xing4.0-29B-A4B-GGUF