开发者用OpenAI实时API驱动机械臂
AI 总结
开发者Tarun122在Reddit上表示，他通过WebRTC将gpt-realtime-2.1接入自建小型机械臂，实现语音交互。演示中，机器人完成了井字棋、将方块放入碗中、选择玩具汽车和递回方块等任务，并通过摄像头视觉定位与仿真训练的抓取策略完成操作。
深度见解
该项目展示了OpenAI Realtime API与视觉模型如何结合仿真机器人策略，实现语音驱动的实体操作。
| I hooked up the OpenAI Realtime API (gpt-realtime-2.1 over WebRTC) to a small robot arm I built, so I can just talk to it. In the video it plays tic-tac-toe with me, puts a cube in a bowl, picks its favourite toy car and hands a cube back to me. How it works: submitted by /u/Tarun122 [link] [comments] |