Qwen3-0.6B-MoE-A0.5B
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Developer releases Qwen3-0.6B MoE conversion with GGUF build
Developer bayliner1980 released Qwen3-0.6B-MoE-A0.5B, a mixture-of-experts conversion of Qwen3-0.6B, together with a GGUF version. The developer adapted the process from Qwen 2.5's qwen2moe to Qwen3's qwen3moe and used a pseudo-shared expert to recover some quality lost because Qwen3 lacks a shared expert. The developer's evaluation found it worse than the dense model on every reported quality metric, with no GPU speed improvement at this size, while the converted model's code was broken and its thinking mode was not trained.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my Qwen3-0.6B-MoE-A0.5B experienceAsk about Qwen3-0.6B-MoE-A0.5B
Nobody has shared their experience with Qwen3-0.6B-MoE-A0.5B yet.