ISTA Deep Algorithms and Systems Lab
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- ISTA releases 1-bit DeepSeek-V4.1-Flash-1017 GSQ-RCO Coder with pruned experts
The ISTA Deep Algorithms and Systems Lab says it has released a Coder build of DeepSeek-V4.1-Flash-1017, a sparse mixture-of-experts model with 384 routed experts per layer (6 active per token) and 763.2B parameters, 551.9B of them in the transformer. The build combines GSQ (Gumbel-Softmax Quantization) with RCO (Riemannian Constrained Optimization) to prune half the routed experts, keeping 192 of 384 per layer and cutting transformer weights to 72.1 GB from 138.2 GB in the unpruned IQ2_XXS build, which the lab rounds to 1 bit per parameter. Reported results show LiveCodeBench v6 at 88.57 versus 89.71 for the base model and SWE-bench Verified at 77.00 versus 81.20, and the GGUF runs in llama.cpp b11870 or newer and in Strata.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my ISTA Deep Algorithms and Systems Lab experienceAsk about ISTA Deep Algorithms and Systems Lab
Nobody has shared their experience with ISTA Deep Algorithms and Systems Lab yet.