Unsloth Flint Q3跨三款智能体框架测试
AI 总结
r/LocalLLaMA一名用户称,unsloth/flint-GGUF的flint-UD-Q3_K_XL.gguf模型在OMP上完成全部12项任务,得分71.2/100、解决7项;在AtomicAgent上也完成全部任务,得分39.2/100、解决3项。测试者表示,Hermes在第7项任务中因广泛搜索文件系统并陷入循环而停止,DeepSeek则因此前框架失败和低分未参加测试。
深度见解
该报告以具体但未经审计的数据呈现同一量化模型在不同AI智能体框架中的表现差异。
| Unsloth Flint Q3 Results Performed quite poorly on benchmark using 3 diff harnesses: OMP: Completed all 12 tasks; 71.2/100 (only 7 solved). AtomicAgent: Completed all 12 tasks; 39.2/100 (only 3 solved). Hermes: Stopped during Task 7 after it performed needless broad searches across the filesystem and looped. Deepseek: Due to previous harness failures and low scores, not run. Full leaderboard https://shortbench.vercel.app/ Current models with 100/100 Score submitted by /u/mesolimbic-bliss [link] [comments] |