XeMaya让新MoE模型原生运行于Intel Arc
开发者创建了XeMaya，这是XeStrata的一个分支，通过SYCL和Level Zero让模型原生运行在Intel Arc GPU上。据r/LocalLLaMA帖子称，这个早期alpha项目已支持DeepSeek V4.1 Flash及Coder、GLM 5.3 Flash和Qwen3.8 Flash-Next，并在Ubuntu服务器上给出了初步预填充与生成速度。开发者表示，测试使用了不同模型文件、提示词和GPU配置，因此对比并非严格受控，项目仍需进一步修复和优化。
XeMaya为多款新MoE模型增加了原生Intel Arc推理方案，但其性能数据仍需受控且独立的验证。
I've been trying to get some of the newer MoE models running on my Intel Arc GPUs, mainly DeepSeek V4.1 Flash and GLM 5.3 Flash. Intel support for these models is still pretty limited, and while I could get some things working through patched llama.cpp builds, performance wasn't exactly great.
fable 5.2 ended up making XeMaya, a fork of XeStrata focused on getting these models running natively on Intel Arc through SYCL and Level Zero. The idea is basically to bring the kind of model support Project Maya has to Intel GPUs.
I've been testing it on my Ubuntu server with a B70 32GB, B65 32GB, B60 24GB, Ryzen 9950X, and 128GB RAM.
Here are some of the results so far. All speeds are prefill / generation in tok/s.
GLM 5.3 Flash
- Stock llama.cpp SYCL: 68.3 / 13.6
- Experimental grouped-matmul SYCL: 108.9 / 14.0
- XeMaya: 152–161 / 17.4 (around 20 generation with MTP)
#XeMaya#XeStrata#Strata#Project Maya#Intel Arc#DeepSeek V4.1 Flash#DeepSeek V4.1 Flash Coder#GLM 5.3 Flash#Qwen3.8 Flash-Next#llama.cpp#fable 5.2