Reddit 用户称 Basalt 输出速度快于 Strata
一名 Reddit 用户称,使用相同的 Qwen3.8 FlashNext-ud-q4_k_xl 模型时,Basalt 的输出速度为每秒 110–170 个 token,而 Strata 为每秒 70–110 个 token。该用户还表示 Basalt 出错更少,推理表现更切合需求;他称 Strata 相比 llama.cpp 有明显改进,但有时会在压缩上下文后混淆自身上下文并过度思考。
该帖为本地模型推理速度提供了一个基于个人经验的信号,但并非经过独立验证的基准测试。
I had been using Strata for about a month, and it was such a huge improvement over llama.cpp for getting it running smoothly and quickly for hardware.
Overtime though, I found that the model would often mistake its own context after a compaction and really overthink things.
I just started using Basalt yesterday after being hesitant to switch and set up all my providers and harnesses. Turns out Basalt runs even faster, is less error prone, and the reasoning is way more on point. If you run 1 GPU, and have the 100 GB+ of VRAM, RAM, and SSD storage, you will not be disappointed in performance.
I mostly care about final output speed, and I was getting 70-110 tok/s on Strata, and Basalt I was getting 110-170 toks/s output. Couldn't be happier. Same Qwen3.8 FlashNext-ud-q4_k_xl, and the NVFP4 ones (of course basalted though)
Anyone else have any other experiences with other similar engines like this?
submitted by /u/HelixTitan [link] [comments]