GLM-5.3-Flash Maya-M GGUF
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Developer proposes mixed CUDA and ROCm inference for Project MAYA
A Reddit developer said they developed a Project MAYA fork and pull request to run GLM-5.3-Flash Maya-M GGUF prefill and decode cooperatively across an NVIDIA RTX 5090 and an AMD Strix Halo iGPU. The CUDA backend handles attention, dense or shared layers, and the expert cache on the RTX 5090, while the ROCm backend executes complementary experts on the Strix Halo during prefill and decode. The developer reported the approach could be up to 48% faster and published experiment results. Project MAYA’s creator welcomed the design and planned to test it before deciding whether to merge it.
r/LocalLLaMA · 🔥 3
Experience and discussion from the community
Share my GLM-5.3-Flash Maya-M GGUF experienceAsk about GLM-5.3-Flash Maya-M GGUF
Nobody has shared their experience with GLM-5.3-Flash Maya-M GGUF yet.