ANEMLL Forge 0.2.1
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Forge 0.2.1 Adds 192K-Context Qwen3.8-27B Support on M6
According to the developer’s report, ANEMLL Forge 0.2.1 can run Qwen3.8-27B on the Neural Engine of a 32GB M6 Mac mini with context windows up to 192K tokens. The release adds an INT8 K/V cache and a smaller drafter that shares the target model’s output head, reportedly saving 0.86GB of ANE memory without reducing speed. The developer reports content-dependent decode rates of 10–62 tokens per second, a 96K configuration using about 21.4GB, and an initial full 192K compilation time of roughly two hours.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my ANEMLL Forge 0.2.1 experienceAsk about ANEMLL Forge 0.2.1
Nobody has shared their experience with ANEMLL Forge 0.2.1 yet.