Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

EVO-WAM lets world action models self-train on verified imagined trajectories

AI summary

Researchers behind EVO-WAM report a self-training loop in which a world action model generates complete imagined video-action trajectories, a vision-language model checks whether the task was completed, and an inverse dynamics model checks that the generated actions match the imagery before verified segments are used for fine-tuning. The team reports that Cosmos3's average success rate rose from 26.9% to 68.0% on seven unseen RoboTwin 2.0 simulation tasks and from 20.0% to 76.7% on three unseen long-horizon real-robot tasks with 10 trials each, while DreamZero improved from 28.5% to 46.4%. An ablation found 43.7% fourth-round success with vision-only filtering versus 68.0% with the action-consistency check, and the authors note gains were not monotonic, with a dip in round three.

In-depth insight

The reported results suggest a world action model can improve on unseen tasks by learning from its own verified imagined trajectories, without new expert demonstrations or trying every candidate action in the environment.

不新增专家示范,也不把候选动作放进外部环境里试错,世界动作模型能否依靠自己的想象继续进化?

当前,已有部分模型能同时预测未来视频和机器人动作,并将视频预训练中积累的知识迁移到陌生任务上。然而,这些模型往往很难产出稳定表现。视频里完成了任务,配套动作却未必与画面一致,生成结果也无法直接用于训练。

EVO-WAM关注的正是这个问题:能否从模型自己生成的轨迹中找出可靠经验,用来改善它在未见任务上的表现?

它让模型自主生成完整的执行画面与动作,筛选通过验证的经验,再用这些经验训练自己,完成想象→验证→学习的循环迭代。

几轮迭代后,在基本保留已见任务性能的同时,模型Cosmos3在七个未见仿真任务上的平均成功率从26.9%提高到68.0%;在三个未见真机长时序组合任务上,从20.0%提高到76.7%。

#EVO-WAM#Cosmos3#DreamZero#RoboTwin 2.0#Qwen3.5-27B

Original · 6 min readRead the original
Group chat

No comments yet. Start the conversation.