ConeML 1.2B experimental
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- ConeML 1.2B experimental MoE opens for reproduction
Solo developer Significant-Serve-58 released the ConeML 1.2B experimental sparse mixture-of-experts model, its GGUF quantization, and an evaluation set. The model has 1.17B stored parameters, activates about 348M per token, and was trained from scratch on roughly 11B tokens; in the developer’s local test, it answered 438 of 512 shuffled fact-chain questions at depth 5, or 85.5%. The developer explicitly said these exploratory results are not controlled training comparisons and that the model is not a general assistant.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my ConeML 1.2B experimental experienceAsk about ConeML 1.2B experimental
Nobody has shared their experience with ConeML 1.2B experimental yet.