Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Qwen3.8 Flash Next Quant Report Nears BF16 Performance

AI summary

A Reddit user reported that Unsloth’s benchmark chart placed the IQ_3S GSQ RCO quantization of Qwen3.8 Flash Next at 99.0% of the BF16 baseline across 12 benchmarks. The report also cited Unsloth’s claim that its UD v3.1 quantization is about 15% better than GSQ RCO at roughly the same file size, although that comparison is a vendor claim and the underlying chart is not independently verified here.

In-depth insight

The reported comparison gives local Qwen users benchmark evidence for choosing between IQ_3S GSQ RCO and UD v3.1 quantized weights.

Unsloth has posted about their UD v3.1 quant for Qwen3.8 FN on X saying their new quant is 15% better than GSQ RCO as the almost same file size. But the takeaway from the post for me and many other how are using IQ_3S GSQ RCO with Strata is that it is 99.0% percent as good as the BF16 The chart of the top left with base line for BF16 is 100% and IQ_3S GSQ RCO scored 99.0% the score is average of 12 benchmarks, and Unsloth kindly has spent ~30b tokens to generate these results. This is reassuring that quant I am running locally is almost as good as the original, if you are in a similar situation this should put your mind at ease. If you are about/plan to download the weights the UD v3.1 quant seems, be about 15% better than IQ_3S GSQ RCO. X post link: https://x.com/UnslothAI/status/2118033433045991660 submitted by /u/DigiDecode_ [link] [comments]

#Qwen3.8 Flash Next#Unsloth#IQ_3S GSQ RCO#UD v3.1#Strata

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.