GSQ
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- ISTA-DASLab releases 1.75–2.25-bit DeepSeek-V4.1-Flash GGUFs
ISTA-DASLab announced three GSQ-RCO GGUF builds of DeepSeek-V4.1-Flash-1017: IQ1_M at 1.75 bits per weight, IQ2_XXS at 2.00 bpw, and IQ2_XS at 2.25 bpw, with backbones ranging from 120.7GB to 155.2GB. The release post says IQ2_XXS matched the base model on the evaluated benchmarks at reasoning effort 50, while a community discussion questioned the saturated benchmarks and noted that no independent KLD or perplexity measurements were supplied. The models reportedly run through Strata on a single 12GB GPU but cannot yet run in llama.cpp because architecture support has not been merged.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my GSQ experienceAsk about GSQ
Nobody has shared their experience with GSQ yet.