创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

ISTA发布1比特DeepSeek-V4.1-Flash-1017 Coder版

AI 总结

ISTA Deep Algorithms and Systems Lab称已发布DeepSeek-V4.1-Flash-1017的Coder版本,该模型为稀疏混合专家架构,每层384个路由专家、每token激活6个,总参数7632亿(其中Transformer部分5519亿)。该版本结合GSQ(Gumbel-Softmax量化)与RCO(黎曼约束优化)剪掉一半路由专家,每层保留192个专家,Transformer权重从未剪枝IQ2_XXS版本的138.2GB降至72.1GB,实验室据此折算为每参数1比特。其报告的结果为LiveCodeBench v6得分88.57(基础模型89.71),SWE-bench Verified为77.00(基础模型81.20),GGUF可在llama.cpp b11870及以上版本与Strata中运行。

深度见解

该发布把低比特量化与带预算约束的专家剪枝结合起来,将7632亿参数MoE模型的权重体积近乎减半,同时据实验室数据保留了大部分代码基准成绩,并以GGUF形式提供下载供llama.cpp与Strata使用。

We have released a Coder build of DeepSeek-V4.1-Flash-1017, compressed with GSQ and RCO, in which half of the model's routed experts have been removed. DeepSeek-V4.1-Flash-1017 is a sparse mixture-of-experts model: 384 routed experts per layer, of which 6 are active per token, 763.2B parameters, 551.9B of them in the transformer. What's inside Why one budget per layer GGUF stores a single expert count for the whole model, so every layer must keep exactly the same number of experts; uneven layers would need padding that gives back the memory pruning saved. RCO treats each layer's budget as a hard constraint and holds all of them exactly at every optimisation step, while the layers are still optimised jointly through one loss on the full model. A penalty formulation would only meet the budgets approximately and would need one tuned coefficient per layer. Results SWE-bench Verified runs long agentic trajectories over real repositories, and tolerates the capacity reduction less well than single-problem code generation, as expected when errors accumulate across turns. Real-world examples, each a single HTML file written by the Coder: an animated SVG of a pelican riding a bicycle, a three.js voxel pagoda garden, and a playable first-person voxel sandbox. For full post incl. videos see: https://x.com/mhelcig/status/2117257900863156518 Links The repository ships the complete per-tensor RCO allocation. The GGUF runs in llama.cpp b11870 or newer and in Strata. The Coder build is an experimental release and feedback is welcome, particularly on capabilities that were not represented in the calibration mixture. Requests for models to quantize or prune are also welcome. From the ISTA Deep Algorithms and Systems Lab. submitted by /u/Loginhe [link] [comments]

#DeepSeek#ISTA Deep Algorithms and Systems Lab#DeepSeek-V4.1-Flash-1017#GSQ#RCO#llama.cpp#Strata

原文约 1 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。