yeasah releases 6bpw EXL3 quantization of Qwen3.8-27B
AI summary
yeasah released a 6bpw EXL3 quantization of Qwen3.8-27B, according to a Reddit post and the linked model listing. The reported comparison gives it a mean KLD of 0.0002, a 23 GB file size, and 18.8 GiB of VRAM for weights, making it the lowest-KLD result listed in that table.
In-depth insight
The reported compression and fidelity figures may be useful to local AI users comparing Qwen3.8-27B quantizations, although the results have not been independently verified.
Noticed this new EXL3 quant of 3.8-27B which achieves lowest KLD than anyone else and does it using only 18.8 GiB VRAM for weights. Pretty impressive numbers!
https://huggingface.co/yeasah/Qwen3.8-27B-exl3
| maker | quant | KLD mean | file size |
|---|---|---|---|
| yeasah | 6bpw | 0.0002 | 23 GB |
| Unsloth | Q8_K_XL | 0.0005 | 31.5 GB |
| Minachist | INT8 AutoRound attn-bf16 | 0.00056 | 36.9 GB |
| turboderp | 6bpw SC | 0.0006 | 23 GB |
submitted by /u/suprjami [link] [comments]