Atomic.Chat releases modified DeepSeek-V4.1-Flash-1017 quantizations
Atomic.Chat released modified GSQ-RCO quantization shards for DeepSeek-V4.1-Flash-1017, changing 82 dense tensors while preserving the original routed experts, headers, file sizes, and Engram file compatibility. The team reported that JailbreakBench refusal rates fell from 85.2%–88.9% to 0% across three quantization sizes, with some refusals still occurring during thinking. Testing used Strata Engine at 8K context on rented hardware; long-context performance and speed on a 12 GB GPU were not verified.
The release provides a concrete method for suppressing refusals in highly quantized DeepSeek-V4.1-Flash-1017 deployments while retaining the original GSQ-RCO routed experts, but its measurements remain a self-published team report with limited hardware validation.
| Measured, refusals 85%→0% even in thinking, 3 sizes 12 GB GPU VRAM, 64GB RAM + SSD via Strata Engine We took ISTA-DASLab's GSQ-RCO quants of DeepSeek-V4.1-Flash-1017 (the ones people run in Strata with a 12 GB GPU and the Engram table on SSD) and removed the refusals. We only touched 82 dense tensors per file: attention output, shared expert down proj and the Engram value proj. The 384 routed experts are byte for byte the same as ISTA's, so their GSQ rounding is kept. Headers and file sizes match too, so you just swap the shards and keep using ISTA's Engram file. Refusals are on JailbreakBench, stock rung -> ours, same Strata setup: We also ran GPQA-Diamond and AIME25 on IQ2_XXS against stock to make sure it didn't get dumber. GPQA came out 83.3% vs 83.3%, AIME 80.0% vs 76.7% (only 30 problems, so call it the same). Things to know: Model: https://huggingface.co/AtomicChat/DeepSeek-V4.1-Flash-1017-Uncensored-GSQ-RCO-GGUF All the measurements: https://huggingface.co/datasets/AtomicChat/DeepSeek-V4.1-Flash-1017-Uncensored-GGUF-metrics Strata Engine: https://github.com/niko1221/strata Thanks to DeepSeek for the base model (MIT), ISTA-DASLab for GSQ-RCO and the Engram file, and the Strata dev for the engine. I'm on the Atomic.Chat team that made this. submitted by /u/gladkos [link] [comments] |
#Atomic.Chat#DeepSeek-V4.1-Flash-1017#ISTA-DASLab#Strata Engine#JailbreakBench#GSQ-RCO#Engram