Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Intel Arc Pro B70 32GB delivers Qwen inference at lower cost

AI summary

A Reddit user reports that a $1,299 Intel Arc Pro B70 32GB achieved about 960 prompt-processing tokens per second and 52 generation tokens per second with Qwen3.8-27B Q6 after tuning Mesa, the llama.cpp SYCL backend, and KV-cache settings. The author says the result was roughly half the RTX 5090's speed at about one-fifth the reported $6,500-plus street price, but says the RTX 5090 figures came from other users' posts rather than direct testing. Setup changes reportedly improved performance substantially, while long-context first-token latency remained a weakness.

In-depth insight

The report provides a practical, locally reproduced configuration showing that a less expensive 32GB Intel card can offer competitive large-language-model throughput when its software stack is properly configured.

#Intel Arc Pro B70 32GB#ASRock#NVIDIA RTX 5090#Qwen3.8-27B#llama.cpp#Ollama#LM Studio#Mesa

Original · 3 min readRead the original
Group chat

No comments yet. Start the conversation.