Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Reddit test says slower Flash-Next tokens improved agent work

AI summary

In an r/LocalLLaMA post, one user reports that Flash-Next running in Strata produced tokens quickly with IQ3_XXS and experimental speed optimizations, but performed poorly on real agent tasks because it overthought and remained stuck in self-doubt. The author says IQ3_S without experimental optimizations was slower in tokens per second but completed real-world work faster, with more meaningful output, less context consumption and reduced compaction.

In-depth insight

The account highlights how raw token throughput can diverge from useful agent-task performance, offering a practitioner observation that local-model users may want to test for themselves.

Maybe this is obvious to many people, but when I started getting into Qwen 3.8 27B or Flash-Next for coding, I initially looked into all the ways to boost performance in terms of tok/sec. I'm using a 5090 with 64 GB system RAM, and when I first installed Strata to test Flash-Next, I picked IQ3_XXS and of course I said yes to experimental speed optimizations - tokens go brrr, right?

What this left me with was a model that produced tokens very fast, but still it felt pretty bad when I'd give an agent real tasks to do. It kept overthinking everything, trapped in constant self-doubt. It thought fast but inefficiently.

Moving to IQ3_S without experimental optimizations has actually been faster in real world tasks. Fewer tokens per second, but the tokens it does produce are more meaningful and it can get the job done with less spinning. And this means slower context burn and reduced compaction.

Haven't fully tested different reasoning levels (mostly tested medium) and I'm also testing how the IQ1 Coder for Deepseek 4.1-Flash compares; it's definitely way slower in tokens per second but I'm not yet sure on successful tasks per hour which is really what I care about.

#Flash-Next#Strata#Qwen 3.8 27B#Deepseek 4.1-Flash#IQ1 Coder#NVIDIA GeForce RTX 5090

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.