创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

社区测试四卡B65上的Qwen长上下文性能

AI 总结

一名社区测试者组装了四卡 Intel Arc Pro B65 系统,并发布 Qwen3.8-Flash-Next-W4A16 与 Qwen3.8-27B 的长上下文扫描结果。测试覆盖多种上下文长度和并发级别,其中一次四卡 INT4 运行显示,Qwen3.8-27B 在零上下文时吞吐量为 50.4 tokens/秒,在 200K 时为 33.8 tokens/秒。测试者还开始尝试把部分模型层卸载到系统内存,但发布时仅对 Flash-Next 完成了此类测试。

深度见解

这份报告填补了公开 Intel Arc Pro B65 基准数据的空缺,提供了不同长上下文、并发级别和量化格式下的持续解码测量。

EDIT: Argh, forgive the formatting, .md and reddit are getting the better of me today! Howdy Folks! New batch of tests from my 4x B65 rig I built, because I was curious to test how the high memory bandwidth works out in reality. This time doing long context sweeps for our most popular models! If there are specific tests that you want to see, hit me up and I'll see if I can fit them in. I'm also starting offload tests, where I put some of the layers into system RAM. So far only doing it with flash-next, but interesting results in the "by model" section of my site for flash-next. Some Examples below, full context sweep list of all the models I tested: https://b65.thekaiser.us/matrices/ AI Generated table from my data: Qwen3.8 context sweeps on Intel Arc Pro B65 Each cell is total throughput / median per-request throughput, in tokens/sec. C1–C16 = requested concurrency. Context lengths use K = 1,024 tokens. * = requests queued (capacity-limited). — = skipped as over capacity, not zero throughput. Qwen3.8-Flash-Next-W4A16 — 4× B65 — INT4 vLLM 0.30.0 · October 18, 2026, 01:06 UTC run Full results Qwen3.8-Flash-Next-W4A16 — 4× B65 — INT4 vLLM 0.30.0 · October 18, 2026, 00:31 UTC run Full results Qwen3.8-27B — 1× B65 — INT4 vLLM 0.31.0+xpu.llmscaler · October 19, 2026 Full results Qwen3.8-27B — 4× B65 — INT4 vLLM 0.31.0+xpu.llmscaler · October 19, 2026 Full results Qwen3.8-27B — 4× B65 — FP8 vLLM 0.32.0 · October 19, 2026 Full results Qwen3.8-27B — 4× B65 — BF16 vLLM 0.32.0 · October 19, 2026 Full results These are sustained-decode measurements from 30-second tests. Per-request values are the recorded medians, not total throughput divided by concurrency. submitted by /u/SamSausages [link] [comments]

#Intel Arc Pro B65#Qwen3.8-Flash-Next-W4A16#Qwen3.8-27B#vLLM

原文约 1 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。