MMLU-Pro
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- UkisAI releases two Swift 1.5 reasoning-efficiency models
UkisAI announced Swift 1.5 GLM-5.3-Flash and Swift 1.5 Ornith-9B, with GGUF and other quantized weights available for local inference. The company says GLM-5.3-Flash cut thinking-token usage by 61.4% on MMLU-PRO with a 0.46% average accuracy loss, while Ornith-9B reduced thinking-token usage by 33.5% without an accuracy loss. These results are vendor claims based on UkisAI's own benchmarks and have not been independently verified.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my MMLU-Pro experienceAsk about MMLU-Pro
Nobody has shared their experience with MMLU-Pro yet.