Reddit benchmark compares GPT-6.1 Sol and Terra on algorithmic problems
A Reddit benchmark post compared Sol 6.1, Terra 6.1, Opus 5.5, Haiku 5.5, Luna 5.6, and Luna 6.0 on four hard algorithmic problems, recording solve time, runtime, and memory usage. The results reported Sol 6.1 as the fastest on three problems, while Terra 6.1 at maximum effort led problem 2271H2; on 2273F, Terra's high effort solved faster than maximum effort, but maximum effort produced a faster, more memory-efficient solution. A later Reddit commenter described Terra's medium and high modes as frontier-level performance without providing independent measurements.
The post provides concrete community benchmark data showing a trade-off between Sol 6.1's reported solve-time lead and Terra 6.1's different reasoning-effort behavior, but the results come from a single Reddit source and have not been independently confirmed.
| Results grouped by problem, sorted by solve time (fastest first). The problems These problems are very challenging for human contestants. The higher the score, the harder one is to solve. Small models like Luna, Haiku are struggling with problems like 2271H2, which are around 200 points. These problem are quite new from the September and October contents, so they are unlikely being trained. Problem 2271G Problem 2271H2 Problem 2273F Problem 2261F2 Fastest Model per Problem Observations https://preview.redd.it/70xx2ctd61yh1.png?width=1861&format=png&auto=webp&s=92a295e5f094ef5514187d8aa594213dae71248f Conclusion Sol 6.1 remains the most intelligent model of the bunch. However, for problems that can be solved with lower models, it would be more costly. Using Sol 6.1 is like having a mathematician writing code: it really determines to prove your code work systematically, that might lead to overengineering. On the other hand, Terra 6.1 might be considered under-engineering. So, I suspect that with Sol creates a slightly overengineered plan and Terra implements slightly lazy, they could balance out their weaknesses. submitted by /u/tuhdo [link] [comments] |
#GPT-6.1 Sol#GPT-6.1 Terra#Opus 5.5#Haiku 5.5#Luna 5.6#Luna 6.0