MiniLM
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- 35 Qwen MoE domain LoRAs released with mixed results
A Reddit author released 35 domain-expert LoRA adapters for Qwen3.6-35B-A3B under Apache-2.0, along with datasets, domain configurations, a MiniLM router, and MLX training scripts. The adapters were trained in BF16 on one 512GB Mac Studio M3 Ultra; 8-bit fusion produced unusable output, while runtime BF16 hot-swapping reportedly took about two seconds per request. On the author's evaluations, routing reached about 46% top-1 and 70% top-3 accuracy, and the base model outperformed most specialist adapters except in HTML/CSS.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my MiniLM experienceAsk about MiniLM
Nobody has shared their experience with MiniLM yet.