M5U
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 2
- Two 256GB M5U systems reportedly cluster worse than running separate models
A Reddit user reports that clustering two 256GB M5U systems produced worse results than running two models separately, citing concurrency issues and inconsistent decode-speed gains. The poster currently runs Qwen Flash Next q6 and GLM3.5 Flash q4 locally, while using DeepSeek through an API, and says GLM q4 outperformed the API for their coding work.
r/LocalLLaMA · 🔥 0 - Reddit user reports GLM and Qwen results on a dual-M5U cluster
A Reddit user reported running GLM 5.3 q6 and Qwen Flash Next q6 on two 256GB M5U units with 80 cores each. The post claims 4.9k prefill and 50 tokens per second for GLM, while Qwen reached 8k prefill and 200 tokens per second through Tensorfold; the author explicitly questioned the GLM prefill figure because it came from an LLM's explanation. The author said DeepSeek configured oMLX from guides and asked the community for optimization advice.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my M5U experienceAsk about M5U
Nobody has shared their experience with M5U yet.