Flash-Next实测:慢速生成反而更高效
r/LocalLLaMA一名用户称,在Strata中使用IQ3_XXS和实验性速度优化时,Flash-Next虽然生成令牌很快,但处理真实智能体任务时容易过度思考并陷入自我怀疑。改用IQ3_S且关闭实验性优化后,每秒令牌数降低,但输出更有意义,上下文消耗和压缩也更少,实际任务完成速度反而更快。
这则实测显示,令牌吞吐量不一定等同于智能体任务的生产效率,为本地模型用户评估推理配置提供了一个值得验证的实践视角。
Maybe this is obvious to many people, but when I started getting into Qwen 3.8 27B or Flash-Next for coding, I initially looked into all the ways to boost performance in terms of tok/sec. I'm using a 5090 with 64 GB system RAM, and when I first installed Strata to test Flash-Next, I picked IQ3_XXS and of course I said yes to experimental speed optimizations - tokens go brrr, right?
What this left me with was a model that produced tokens very fast, but still it felt pretty bad when I'd give an agent real tasks to do. It kept overthinking everything, trapped in constant self-doubt. It thought fast but inefficiently.
Moving to IQ3_S without experimental optimizations has actually been faster in real world tasks. Fewer tokens per second, but the tokens it does produce are more meaningful and it can get the job done with less spinning. And this means slower context burn and reduced compaction.
Haven't fully tested different reasoning levels (mostly tested medium) and I'm also testing how the IQ1 Coder for Deepseek 4.1-Flash compares; it's definitely way slower in tokens per second but I'm not yet sure on successful tasks per hour which is really what I care about.
#Flash-Next#Strata#Qwen 3.8 27B#Deepseek 4.1-Flash#IQ1 Coder#NVIDIA GeForce RTX 5090