MacBook M5
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Transformers streams SSD-hosted experts for 180B MoE inference
Tarek Ziadé reported a Transformers implementation that streams quantized MoE experts from SSD into a bounded device cache, enabling the 180B-parameter Qwen3.8-Flash-Next model to run on a MacBook M5 with 32 GB of unified memory. The author measured 13.9 tokens per second after optimization and said this remained about 6% behind Strata, with per-layer synchronization identified as the remaining gap. The implementation is available through an open pull request, but its API was still under discussion with maintainers.
Hugging Face · 🔥 1
Experience and discussion from the community
Share my MacBook M5 experienceAsk about MacBook M5
Nobody has shared their experience with MacBook M5 yet.