创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

Reddit 用户称 Basalt 输出速度快于 Strata

AI 总结

一名 Reddit 用户称,使用相同的 Qwen3.8 FlashNext-ud-q4_k_xl 模型时,Basalt 的输出速度为每秒 110–170 个 token,而 Strata 为每秒 70–110 个 token。该用户还表示 Basalt 出错更少,推理表现更切合需求;他称 Strata 相比 llama.cpp 有明显改进,但有时会在压缩上下文后混淆自身上下文并过度思考。

深度见解

该帖为本地模型推理速度提供了一个基于个人经验的信号,但并非经过独立验证的基准测试。

I had been using Strata for about a month, and it was such a huge improvement over llama.cpp for getting it running smoothly and quickly for hardware.

Overtime though, I found that the model would often mistake its own context after a compaction and really overthink things.

I just started using Basalt yesterday after being hesitant to switch and set up all my providers and harnesses. Turns out Basalt runs even faster, is less error prone, and the reasoning is way more on point. If you run 1 GPU, and have the 100 GB+ of VRAM, RAM, and SSD storage, you will not be disappointed in performance.

I mostly care about final output speed, and I was getting 70-110 tok/s on Strata, and Basalt I was getting 110-170 toks/s output. Couldn't be happier. Same Qwen3.8 FlashNext-ud-q4_k_xl, and the NVFP4 ones (of course basalted though)

Anyone else have any other experiences with other similar engines like this?

submitted by /u/HelixTitan [link] [comments]

#Basalt#Strata#llama.cpp#Qwen3.8 FlashNext-ud-q4_k_xl

原文约 1 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。