Reddit用户称Strata将Qwen解码速度提升至150 tok/s
一名Reddit用户称,将Qwen 3.8 Flash Next从llama-server切换到Strata后,解码速度从70–80 tok/s提升至150 tok/s。该用户列出的测试配置为“1 pro 6000”、两张RTX 3090、256 GB DDR4和160k上下文。该用户还称,DeepSeek V4.1 Flash的2.25位版本使用Unsloth 6位量化时,解码速度为70 tok/s,并表示不知道Strata采用了什么实现方法。
Have been using qwen 3.8 flash next with llamaserver. Was getting 70-80tk/s decode and was happy. Then read about strata and decided to give it a try. Decode shot up to 150 tk/s. Not sure what magic it's using? You should give it a try if you are still running qwen flash next on llamacpp. Also the tried DeepSeek v4.1flash 2.25bit and it's 70tk/s decode.
Unsloth 6 bit quant
160k context
1 pro 6000 + 2 x 3090
256G ddr4
submitted by /u/lblblllb [link] [comments]
#Strata#Qwen 3.8 Flash Next#llama.cpp#DeepSeek V4.1 Flash#Unsloth