开发者发布开源 Deepthink 智能体扩展系统
AI 总结
Ryoiki-Tokuiten 发布了 Deepthink,这是一个利用智能体群对困难问题实施测试时扩展的开源系统。开发者仅使用 Gemma4-35B 和 Qwen-3.8-27B 进行测试,称每道题约消耗 2 亿个 token,并使 15 道 BrokenArxiv 题目的得分从 14% 升至 65%,8 道 DeepSWE 题目的得分从 9% 升至 52%。这些结果尚未得到独立复现;开发者还表示,运行时间会随配置深度和推理速度而异,可能从 50 分钟到 30 小时。
深度见解
Deepthink 提供了智能体群测试时扩展的开源实现,但其准确率提升、通用可用性和计算开销仍缺乏独立验证。
| I have been working on test-time scaling for quite some time now. Posted some of my previous work on this sub-reddit before. Recently, I made significant simplifications to the core system-design and it finally felt like now anybody can understand and directly use this on their hardest problems. Just on a side-note though, depending on the depth you set & your LLM's inference speed, it can take from 50 Minutes to 30 hours to give you back the results. For benchmarks I couldn't test this on frontier models or even large open models because it will be way too expensive. I directly only tested this on Gemma4-35B & Qwen-3.8-27B. They spent around 200M tokens / problem and there scores went from 14% to 65% on BrokenArxiv (Matharena) 15 problems or from 9% to 52% on 8 DeepSWE problems. I know that's almost unbelievable, but you can try and see that yourself. Repo Link: https://github.com/ryoiki-tokuiten/Deepthink submitted by /u/Ryoiki-Tokuiten [link] [comments] |