创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

Reddit用户称Strata在双R9700上不及llama.cpp

AI 总结

一名Reddit用户用两块Radeon R9700测试Strata推理引擎和Qwen Next Flash,称只能达到Q3量化, Experts卸载到内存时还会在长任务中卡死。用户称纸面速度约为每秒60个token,但HumanEval+成绩为3-bit Flash-Next的93.9%,低于llama.cpp下Qwen3.8-27B Q8的95.1%,且所需token接近两倍。发帖者同时质疑,模型专用推理引擎的正面社区报告是否只是炒作或特殊情况。

深度见解

该帖提供了详细的社区测试和实际运行记录,但证据仅来自单个用户的配置,不能据此判断Strata的普遍表现。

My intention was to find a setup at least equal to qwen 3.8 27b Q8 MTP but with a larger context. Ideally 1M.

I was already running Next Flash in Q2 with llama. Good for conversational use but not for coding. Q4 would run but too slow. I did read many reports here on the good performance of strata with qwen next flash. I figured both are around for long enough to be stable so I gave it a shot.

The results however are very disappointing. All I was able to achieve was moving to Q3. Brining the question, are most of the posts on alternative engines just hype or edge cases? Certainly looks like that to me.

Some details on my try:

Two cards plus experts offloaded to RAM: hangs on every long tasks, whatever settings I tried.

Stable only when every expert fits in VRAM. On 64 GB that means a 3-bit quant.

Faster on paper: ~60 t/s against llama.cpp. But on HumanEval+ the 3-bit Flash-Next scored 93.9% against 95.1% for Qwen3.8-27B Q8 on plain llama.cpp, and it needed nearly twice the tokens to get there. No, advantage.

So for my use, no real-world gain over a mature stack. Instead of one stable engine, you get a single-model engine, its forks, special quants and a pile of environment-variable workarounds.

Is that just Strata being young, or is it systematic? Has anyone actually gotten a lasting real-world benefit from one of these model-specific engines over llama.cpp or vLLM?

submitted by /u/Don_Reuter [link] [comments]

#Strata#llama.cpp#vLLM#Qwen Next Flash#Qwen3.8-27B#AMD Radeon R9700

原文约 1 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。