M6 Mac mini
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Forge 0.2.1 Adds 192K-Context Qwen3.8-27B Support on M6
According to the developer’s report, ANEMLL Forge 0.2.1 can run Qwen3.8-27B on the Neural Engine of a 32GB M6 Mac mini with context windows up to 192K tokens. The release adds an INT8 K/V cache and a smaller drafter that shares the target model’s output head, reportedly saving 0.86GB of ANE memory without reducing speed. The developer reports content-dependent decode rates of 10–62 tokens per second, a 96K configuration using about 21.4GB, and an initial full 192K compilation time of roughly two hours.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my M6 Mac mini experienceAsk about M6 Mac mini
Nobody has shared their experience with M6 Mac mini yet.