Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

ISTA Deep Algorithms and Systems Lab

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 1

  1. ISTA releases 1-bit DeepSeek-V4.1-Flash-1017 GSQ-RCO Coder with pruned experts

    The ISTA Deep Algorithms and Systems Lab says it has released a Coder build of DeepSeek-V4.1-Flash-1017, a sparse mixture-of-experts model with 384 routed experts per layer (6 active per token) and 763.2B parameters, 551.9B of them in the transformer. The build combines GSQ (Gumbel-Softmax Quantization) with RCO (Riemannian Constrained Optimization) to prune half the routed experts, keeping 192 of 384 per layer and cutting transformer weights to 72.1 GB from 138.2 GB in the unpruned IQ2_XXS build, which the lab rounds to 1 bit per parameter. Reported results show LiveCodeBench v6 at 88.57 versus 89.71 for the base model and SWE-bench Verified at 77.00 versus 81.20, and the GGUF runs in llama.cpp b11870 or newer and in Strata.

    r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my ISTA Deep Algorithms and Systems Lab experienceAsk about ISTA Deep Algorithms and Systems Lab

Nobody has shared their experience with ISTA Deep Algorithms and Systems Lab yet.