Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Community tester benchmarks Qwen models on four Intel Arc Pro B65 GPUs

AI summary

A community tester built a four-card Intel Arc Pro B65 system and published long-context sweeps for Qwen3.8-Flash-Next-W4A16 and Qwen3.8-27B. The tests covered multiple context lengths and concurrency levels; one four-card INT4 run reported Qwen3.8-27B throughput of 50.4 tokens per second at zero context and 33.8 tokens per second at 200K. The author also began system-RAM offload tests, which had only been performed with Flash-Next at publication.

In-depth insight

The report fills a noted gap in public Intel Arc Pro B65 benchmarks by providing sustained-decode measurements across long contexts, concurrency levels, and quantization formats.

EDIT: Argh, forgive the formatting, .md and reddit are getting the better of me today! Howdy Folks! New batch of tests from my 4x B65 rig I built, because I was curious to test how the high memory bandwidth works out in reality. This time doing long context sweeps for our most popular models! If there are specific tests that you want to see, hit me up and I'll see if I can fit them in. I'm also starting offload tests, where I put some of the layers into system RAM. So far only doing it with flash-next, but interesting results in the "by model" section of my site for flash-next. Some Examples below, full context sweep list of all the models I tested: https://b65.thekaiser.us/matrices/ AI Generated table from my data: Qwen3.8 context sweeps on Intel Arc Pro B65 Each cell is total throughput / median per-request throughput, in tokens/sec. C1–C16 = requested concurrency. Context lengths use K = 1,024 tokens. * = requests queued (capacity-limited). — = skipped as over capacity, not zero throughput. Qwen3.8-Flash-Next-W4A16 — 4× B65 — INT4 vLLM 0.30.0 · October 18, 2026, 01:06 UTC run Full results Qwen3.8-Flash-Next-W4A16 — 4× B65 — INT4 vLLM 0.30.0 · October 18, 2026, 00:31 UTC run Full results Qwen3.8-27B — 1× B65 — INT4 vLLM 0.31.0+xpu.llmscaler · October 19, 2026 Full results Qwen3.8-27B — 4× B65 — INT4 vLLM 0.31.0+xpu.llmscaler · October 19, 2026 Full results Qwen3.8-27B — 4× B65 — FP8 vLLM 0.32.0 · October 19, 2026 Full results Qwen3.8-27B — 4× B65 — BF16 vLLM 0.32.0 · October 19, 2026 Full results These are sustained-decode measurements from 30-second tests. Per-request values are the recorded medians, not total throughput divided by concurrency. submitted by /u/SamSausages [link] [comments]

#Intel Arc Pro B65#Qwen3.8-Flash-Next-W4A16#Qwen3.8-27B#vLLM

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.