创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

Blockway 发布 Volundr 32B v1

AI 总结

Blockway 在 r/LocalLLaMA 发布 Agens Volundr 32B v1,称针对 Preview 版被社区指出的问题做了修正:SWE-bench 任务上的重复循环从 36/50 降到 0/50,SWE-bench Verified(50 题子集)从 22/50 升到 27/50,τ²-bench 从 89 升到 92/120,SWE 任务中位耗时从 124 分钟降到 82 分钟。团队同时以 MIT 许可证开源 Agens Engine 推理引擎,称其在这套混合架构上比自家 SGLang 构建单流解码快 1.4–1.6 倍,并提供约 2.85 比特/权重、在 16GB 内存预算内支持 262K 上下文的构建。上述基准与速度均为厂商自报:16GB 数据是在 48GB 显卡的 16GiB 硬上限下测得,该位宽下 GPQA 降至 73.7(bf16 为 80.3),且团队称 stock vLLM 无法加载该架构、SGLang 与 llama.cpp 仍需其自家构建。

深度见解

Blockway 称 v1 构建与 MIT 引擎的目标是让 32B 模型在消费级 GPU 上本地运行,但同时也说明该架构尚需自家 SGLang/llama.cpp 构建,stock vLLM 无法加载。

https://reddit.com/link/1x8yc8d/video/hosf7c1n27wh1/player Hi r/LocalLLaMA. I'm on the team at Blockway (disclosure: this is our model). Two weeks ago we posted the Volundr 32B Preview here, and you were blunt about what was wrong with it. This is v1, and most of the work went into what you flagged. WHAT v1 FIXES FROM THE PREVIEW "MAKE IT RUN ON CONSUMER GPUS" → AGENS ENGINE (MIT) We're open-sourcing Agens Engine under the MIT licence. It's an inference engine built for this hybrid architecture: 54 of 72 layers keep a fixed-size state instead of a KV cache, and the engine is designed around that. STRENGTHS (same harness and settings as our comparison model) FULL TABLE (Preview → v1; dips included. Where we ran a benchmark more than once, we report the best of N runs. Every run is listed in the model card footnote.) A few scores went down (GPQA, HumanEval, IFBench). The HumanEval and IFBench dips are within one standard error of the runs; GPQA's isn't. That's the trade-off from tuning for agent behaviour and shorter reasoning. Harness settings are in the footnote under the results table: huggingface.co/Blockway/Agens-Volundr-32B-v1#results-same-harness-for-every-row Thanks to mmssix on Hugging Face for the independent benchmark write-up in our HF discussions. A lot of the above started there. KNOWN LIMITATIONS LINKS We'll be in the comments for the next couple of days. "Why doesn't X work yet" questions are welcome. https://preview.redd.it/4d8or6olv6wh1.png?width=2360&format=png&auto=webp&s=a83cbce77656ec8d9f28d9a3f9a5bfb8b96ce989 https://preview.redd.it/koyrx6olv6wh1.png?width=2360&format=png&auto=webp&s=6817372b70f3d4c7230fed90593c0a7015cbcc18 submitted by /u/ComfortableKindly507 [link] [comments]

#Blockway#Agens Volundr 32B v1#Agens Engine#DFlash2#SGLang#llama.cpp#Qwen3.8-27B#Hugging Face

原文约 1 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。