RoboColosseum launches open real-world robot evaluation
Hugging Face announced that it is a founding partner of RoboColosseum, an open evaluation initiative for robot models. RoboColosseum says participants can access more than 100 physical robots, including Unitree G1 and LeRobot SO-101 systems, across more than 140 real-world scenes, with rollout data—including failures—published on the Hugging Face Hub.
The initiative could give robotics developers a shared way to evaluate models with real robots and openly inspect rollout outcomes, including failures.
Evaluating robot models in the real world is hard, but solvable. That's why we're a founding partner of RoboColosseum 🤗
100+ real robots, 140+ in-the-wild scenes, and every rollout, failures included, open on the Hub. https://twitter.com/RoboColosseum/status/2117982605274710483
@RoboColosseum: Introducing RoboColosseum An open robot eval initiative by @huggingface @BitRobotNetwork @eaic_sg @DJiafei Access: - 100+ robots (@UnitreeRobotics G1s, @LeRobotHF SO-101s, YAMs, Franka and more) - 140+ in-the-wild scenes - Open rollout data - 10,000 FREE eval hrs Thread ↓ https://x.com/RoboColosseum/status/2117982605274710483/video/1 https://x.com/RoboColosseum/status/2117982605274710483
#Hugging Face#RoboColosseum#BitRobot Network#Unitree G1#LeRobot SO-101#YAM#Franka