Reddit 基准比较 GPT-6.1 Sol 与 Terra 算法表现
AI 总结
一篇 Reddit 基准测试帖子比较了 Sol 6.1、Terra 6.1、Opus 5.5、Haiku 5.5、Luna 5.6 和 Luna 6.0 在四道高难度算法题上的解题时间、运行时间和内存。结果显示，Sol 6.1 在三道题上最快；Terra 6.1 以最大 effort 在 2271H2 上最快。在 2273F 上，Terra 的 high effort 解题快于 maximum effort，但 maximum effort 生成的方案运行速度更快、内存效率更高。另一位 Reddit 用户称 Terra 的 medium 和 high 模式达到前沿水平，但未提供独立测量数据。
深度见解
该帖子提供了具体的社区基准数据，显示 Sol 6.1 的解题时间领先与 Terra 6.1 不同推理 effort 表现之间的取舍，但结果仅来自一个 Reddit 来源，尚未得到独立确认。
| Results grouped by problem, sorted by solve time (fastest first). The problems These problems are very challenging for human contestants. The higher the score, the harder one is to solve. Small models like Luna, Haiku are struggling with problems like 2271H2, which are around 200 points. These problem are quite new from the September and October contents, so they are unlikely being trained. Problem 2271G Problem 2271H2 Problem 2273F Problem 2261F2 Fastest Model per Problem Observations https://preview.redd.it/70xx2ctd61yh1.png?width=1861&format=png&auto=webp&s=92a295e5f094ef5514187d8aa594213dae71248f Conclusion Sol 6.1 remains the most intelligent model of the bunch. However, for problems that can be solved with lower models, it would be more costly. Using Sol 6.1 is like having a mathematician writing code: it really determines to prove your code work systematically, that might lead to overengineering. On the other hand, Terra 6.1 might be considered under-engineering. So, I suspect that with Sol creates a slightly overengineered plan and Terra implements slightly lazy, they could balance out their weaknesses. submitted by /u/tuhdo [link] [comments] |
#GPT-6.1 Sol#GPT-6.1 Terra#Opus 5.5#Haiku 5.5#Luna 5.6#Luna 6.0