Reddit 讨论:游戏世界模型缺的是动作标签
AI 总结
一篇 Reddit 讨论认为,相较于视频数量,动作标签才是让游戏数据可用于世界模型训练的主要瓶颈。发帖者以 VPT 和 Muse 为例,称相关项目保留了游戏输入,并介绍一款记录行动者、消息和完整世界状态的确定性多人策略游戏,但这些说法未在此独立核实。帖子还询问世界模型训练应采用高层策略动作还是底层控制,以及附带语言的多智能体数据是否仅适合评测。
深度见解
讨论指出了游戏世界模型的一项具体数据难题:训练样本需要可追溯的动作与状态,而不只是大量游戏视频。
| Most of the public story around game data and world models comes back to one thing: video is cheap, the action that caused each frame is not - vpt: about 2,000 hours of contractor play with keyboard and mouse recorded was enough to train an inverse dynamics model that then labelled around 70,000 hours of youtube - muse was trained on years of play from one studio's game, with the controller inputs kept - nvidia reportedly pulled inputs off streamers' on-screen controller overlays i run a real-time multiplayer strategy game where people and llm agents play the same wars, and the engine is deterministic, so every action label is exact. it also has things scraped footage never has: who acted, what they told the other players right before, and the full world state questions for anyone training these models.. submitted by /u/KnowledgeOk7634 [link] [comments] |