Project MAYA

Headlines · 5

1. 1h
   XeMaya brings native Intel Arc inference to recent MoE models

   A developer built XeMaya, a fork of XeStrata that runs models natively on Intel Arc GPUs through SYCL and Level Zero. The early-alpha project reportedly supports DeepSeek V4.1 Flash and Coder, GLM 5.3 Flash, and Qwen3.8 Flash-Next, with preliminary prefill and generation results reported on an Ubuntu server. The developer cautioned that different model files, prompts, and GPU configurations made the comparisons uncontrolled, leaving further fixes and optimization needed.

   r/LocalLLaMA · 🔥 5
2. 23h
   Developer proposes mixed CUDA and ROCm inference for Project MAYA

   A Reddit developer said they developed a Project MAYA fork and pull request to run GLM-5.3-Flash Maya-M GGUF prefill and decode cooperatively across an NVIDIA RTX 5090 and an AMD Strix Halo iGPU. The CUDA backend handles attention, dense or shared layers, and the expert cache on the RTX 5090, while the ROCm backend executes complementary experts on the Strix Halo during prefill and decode. The developer reported the approach could be up to 48% faster and published experiment results. Project MAYA’s creator welcomed the design and planned to test it before deciding whether to merge it.

   r/LocalLLaMA · 🔥 3
3. 5d
   Delta Inference Engine v0.93 expands local DeepSeek inference support

   The developer released Delta Inference Engine v0.93 with support for 64, 96 and 128 GB of RAM, Unsloth quantization formats, EXL3 and basic multi-GPU configurations. On one Windows system with an RTX 3090, the reported Unsloth UD-IQ2_XXS configuration reached 41 tokens per second with 192 GB RAM and scored 57 out of 99 on the developer’s benchmark, compared with 52 for the previous default quantization and 59 for the full model via API. The update also includes public CI builds, faster prompt handling and fixes for long contexts and large model files.

   r/LocalLLaMA · 🔥 0
4. Nov 1
   MiniMax highlights local quantization work for M3.1 Flash

   MiniMax highlighted community efforts to run its 428B-parameter MiniMax M3.1 Flash model locally using lower-bit weights, specialized kernels, and expert placement across GPUs and system RAM. The projects include Unsloth's 143.9 GB 2-bit Dynamic GGUF weights, ViC305's SAGE-EXL3 recipe for one DGX Spark, PeasantSmith's Project Maya quantizations, and additional work from MiaAI Lab, oMLX, and others. A LocalLLaMA review noted that the reported sizes, fidelity scores, and speed figures used separate evaluation sets and are not directly comparable.

   MiniMax_AI (X) · 🔥 0
5. Oct 12
   Zhipu AI grey-tests GLM-5.3 HighSpeed in ZCode at over 490 tokens/s

   Zhipu AI has quietly started a limited grey test of its GLM-5.3 HighSpeed model inside its AI coding tool ZCode, according to 智东西 and 36氪 人工智能, which republished the same report. AI coding blogger Leo said his grey-test instance exceeded 490 output tokens per second, while the AI Ping platform cited in the report measured the standard GLM-5.3 API at 70.84 tokens/s and DeepSeek V4.1 Flash's official API at 121.34 tokens/s. The variant is randomly opened to ZCode subscribers with no application entry point, and it had already appeared on the open-source coding agent Pi harness site about a month earlier with pricing undisclosed. Separately, a Reddit user reported that the open-source Project Maya runtime raised their local GLM-5.3-Flash throughput from about 10 to 30 tokens/s.

   智东西 · 🔥 0

Experience and discussion from the community

Share my Project MAYA experienceAsk about Project MAYA