GPT-6 Sol训练虚拟Microduck行走并识别猫
在Will Knight的AI Lab报道中,他描述了如何使用OpenAI的GPT-6 Sol编写并训练虚拟Microduck。这是一款来自Pollen Robotics和Hugging Face的机器人,能够在房间内行走并识别孟加拉猫。训练过程使用Nvidia的Isaac Sim向控制机器人的模型发送指令、查看仿真视频并建议训练调整。Knight称,整个编码和训练过程仅用了数小时,并表示类似工作过去可能需要数周才能摸索完成。报道还介绍了Astra生成的机器人仿真、开源的Aspire框架以及机械臂控制演示。Knight表示,实体Microduck尚未到货,机器鸭的视觉系统尚不足以在真实产品中部署,但他认为仿真的行为应能迁移到实体机器人上。
该报道具体展示了涵盖代码生成、仿真、视频观察和迭代训练的AI辅助机器人开发流程,同时也凸显了仍待解决的工程难题:可靠的机器人系统仍需要大量专业工作,虚拟Microduck的视觉系统也尚未达到产品部署要求。
Allow me to introduce you to the robot cat butler I’m developing with help from AI.
Using OpenAI’s GPT-6 Sol, I taught a virtual version of Microduck—a cute robot from Pollen Robotics and Hugging Face—to walk around a room and identify any bengal cats in its vicinity. (The clip above shows the robot waddling toward a target feline; its eye view is shown top right.)
I’m still waiting patiently for a physical Microduck—please hurry up and ship it, guys—but simulated behavior is relatively simple, so it should transfer over to the real thing. I plan to have the robot automatically dispense a treat for my pet bengal, Leona, perhaps by bowing its head to release one from a 3D-printed, head-mounted storage chamber.
I was able to code and train the virtual robot in just a few hours, which is, quite frankly, incredible. Previously, this kind of thing might have taken me weeks to figure out. It was possible because OpenAI’s latest models are remarkably good at understanding and manipulating 3D representations of the physical world and then translating that into useful code, agentic actions, and robot training.
#OpenAI#GPT-6 Sol#Microduck#Pollen Robotics#Hugging Face#Hermes#Nvidia#DGX Spark#Isaac Sim#Astra#Aspire#Newton