Reddit 用户质疑 llama.cpp 落后于定制推理引擎
r/LocalLLaMA 的一名 Reddit 用户认为,llama.cpp 已落后于 Strata 等较新的本地推理项目,同时承认这种批评可能过重,自己仍会用它运行 27B 模型。该用户还称,当前的推理引擎生态包含大量分叉项目,并计划在现有 GPU 基准测试结束后测试 Avalon。
这则帖子呈现了用户对 llama.cpp 是否落后于新型本地推理引擎的未经核实看法,而针对 Avalon 的测试尚未完成。
When I started, and for some time, llama.cpp was the answer.
Now, it seems like llama.cpp is the new ollama. It's slow and out of date and just behind.
There was Ninfee for those for whom that applied.
Then strata came out... And that was an unimaginable upgrade. How is llama so far behind?
Now every day someone has their own forked engine that claims even better numbers. I already maxed out my token budget on Claude for the week and have my GPUs all running benchmarks so I'm waiting a few days, but I'll be trying Avalon to see if that lives up to the hype for my machine.
Then there's basalt. There's beatleguese?
#llama.cpp#Ollama#Ninfee#Strata#Avalon#Basalt#Claude#Flash Next