创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

Reddit用户称Strata将Qwen解码速度提升至150 tok/s

AI 总结

一名Reddit用户称,将Qwen 3.8 Flash Next从llama-server切换到Strata后,解码速度从70–80 tok/s提升至150 tok/s。该用户列出的测试配置为“1 pro 6000”、两张RTX 3090、256 GB DDR4和160k上下文。该用户还称,DeepSeek V4.1 Flash的2.25位版本使用Unsloth 6位量化时,解码速度为70 tok/s,并表示不知道Strata采用了什么实现方法。

Have been using qwen 3.8 flash next with llamaserver. Was getting 70-80tk/s decode and was happy. Then read about strata and decided to give it a try. Decode shot up to 150 tk/s. Not sure what magic it's using? You should give it a try if you are still running qwen flash next on llamacpp. Also the tried DeepSeek v4.1flash 2.25bit and it's 70tk/s decode.

Unsloth 6 bit quant

160k context

1 pro 6000 + 2 x 3090

256G ddr4

submitted by /u/lblblllb [link] [comments]

#Strata#Qwen 3.8 Flash Next#llama.cpp#DeepSeek V4.1 Flash#Unsloth

原文约 1 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。