本地 Qwen3.8-Flash-Next 与 Claude 审查同一次提交
一名 Reddit 用户通过 Claude Code 在本地运行 Qwen3.8-Flash-Next,审查 ChatOKF 仓库中的一次代码提交,并由 Claude Opus 担任比较评审者。发帖者称,Qwen 提出八项有效发现且没有误报,其中包括 Claude 漏掉的两项问题,但漏掉了 Claude 发现的五项问题,并有两处细节判断错误。测试采用 UD-Q4_K_XL 量化、启用 ROCm 的 llama-server、配备 128 GB 内存的 AMD Strix Halo、262K 上下文和 MTP 草稿头;解码速度据称从 4K 上下文下约 21 token/s 降至 128K 下约 14 token/s。
这份报告记录了将私有本地模型用作代码审查首轮检查的一手经验,同时提醒使用者应验证其发现机制,也不要将其视为细微逻辑问题的最终判断。测试仅涵盖一次提交和一次运行,加上 Claude 作为比较评审者存在其已承认的偏见,因此结果应被视为个案,而非基准测试。
I am seriously impressed and want to share my experience.
Qwen3.8-Flash-Next (local) vs Claude in Claude Code: reviewing one real commit
I ran the same code review twice on one commit in my repo https://github.com/leok7v/ChatOKF (Swift, on-device LLM chat app, about 48 files changed, +1048/-102: a module move plus a new 783-line search harness).
Setup: Qwen3.8-Flash-Next UD-Q4_K_XL (unsloth) on llama-server, ROCm, AMD Strix Halo 128 GB, 262K context, MTP draft head, driven headless by Claude Code itself (claude -p pointed at the local server, read-only tools). The comparison reviewer was Claude (Opus) in Claude Code, which reviewed blind first and then judged Qwen's review against the code. Yes, Claude judging its own competitor is a bias; every finding below was checked against the source, and the main one with a small Swift repro.
Result: Qwen produced 8 findings, all real, zero false positives. It caught 2 things Claude missed (a test harness that does not follow the app's recall path, and a markdown ingest that takes the frontmatter "---" as a description). It missed 5 that Claude found, including the most important one: a stop-word filter that compares stemmed words with an unstemmed list, so "this" and "does" leak through as search terms. It also got two details wrong (the exact fallback behavior of a failable init, and column counts off by a few). Severity calibration and the "checked and fine" section were good. It read whole files and chased module boundaries like a careful human.
#Qwen3.8-Flash-Next#Claude#Claude Opus#Claude Code#llama-server#llama.cpp#ROCm#AMD Strix Halo#MTP#ChatOKF