Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Reddit user reports Strata raises Qwen decode speed to 150 tok/s

AI summary

A Reddit user reported that switching from llama-server to Strata raised Qwen 3.8 Flash Next decode speed from 70–80 tok/s to 150 tok/s. The user listed the setup as “1 pro 6000,” two RTX 3090s, 256 GB DDR4 and a 160k context window. The same user reported 70 tok/s decode for DeepSeek V4.1 Flash at 2.25-bit, with an Unsloth 6-bit quant, and said they did not know what implementation method Strata used.

Have been using qwen 3.8 flash next with llamaserver. Was getting 70-80tk/s decode and was happy. Then read about strata and decided to give it a try. Decode shot up to 150 tk/s. Not sure what magic it's using? You should give it a try if you are still running qwen flash next on llamacpp. Also the tried DeepSeek v4.1flash 2.25bit and it's 70tk/s decode.

Unsloth 6 bit quant

160k context

1 pro 6000 + 2 x 3090

256G ddr4

submitted by /u/lblblllb [link] [comments]

#Strata#Qwen 3.8 Flash Next#llama.cpp#DeepSeek V4.1 Flash#Unsloth

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.