Grok 4.20 在《宝可梦红》中据称陷入数百回合循环
PokeBench 作者 /u/VibeCodyH 称，Grok 4.20 的非推理配置在第 36 回合离开角色房屋，但直到第 755 回合才获得初始宝可梦。据称，模型笔记记录了持续 90 多回合的无效摆动、反复撞墙和持续循环，随后仍继续撞墙。作者还称，Grok 4.6 用 316 个回合击败 Brock，费用约为 10 美元，而 Grok 4.20 消耗约 30 美元，且勉强获得初始宝可梦。
相关日志提供了一个具体的智能体失败案例：模型识别出了自身重复循环却未能脱困，同时其推进速度和报告中的成本表现均劣于 Grok 4.6。
I've been reading the turn logs from PokeBench. My benchmark where vision models play Pokemon Red. Grok 4.20 non-reasoning left the house at turn 36 and didn't get a starter until turn 755. The whole time its notes say things like "We've been oscillating uselessly for 90+ turns" and later "The persistent loop of walking into walls and Mom's dialogue has continued for hundreds of turns." Then it walks into the wall again.
So it knows it's stuck and still can't get out. Grok 4.6 beat Brock in 316 turns for about $10, while 4.20 burned $30 and barely got its starter.
Why do you think a model can describe its own loop correctly and still not break it? Vision problem or planning problem?
submitted by /u/VibeCodyH [link] [comments]