Reddit user reports faster output speeds with Basalt than Strata
A Reddit user reports that Basalt produced 110–170 output tokens per second, compared with 70–110 tokens per second from Strata, using the same Qwen3.8 FlashNext-ud-q4_k_xl model. The user also says Basalt was less error-prone and that its reasoning was more on point. They describe Strata as a major improvement over llama.cpp, but say it sometimes confused its context after compaction and overthought tasks.
The post provides an anecdotal signal about local model inference speed, but it is based on one user's experience rather than an independently verified benchmark.
I had been using Strata for about a month, and it was such a huge improvement over llama.cpp for getting it running smoothly and quickly for hardware.
Overtime though, I found that the model would often mistake its own context after a compaction and really overthink things.
I just started using Basalt yesterday after being hesitant to switch and set up all my providers and harnesses. Turns out Basalt runs even faster, is less error prone, and the reasoning is way more on point. If you run 1 GPU, and have the 100 GB+ of VRAM, RAM, and SSD storage, you will not be disappointed in performance.
I mostly care about final output speed, and I was getting 70-110 tok/s on Strata, and Basalt I was getting 110-170 toks/s output. Couldn't be happier. Same Qwen3.8 FlashNext-ud-q4_k_xl, and the NVFP4 ones (of course basalted though)
Anyone else have any other experiences with other similar engines like this?
submitted by /u/HelixTitan [link] [comments]