EgoX
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 3
- Vbot releases Exo2EgoPolicy for egocentric robot data
Vbot has released Exo2EgoPolicy, a cross-view generation model that the company says converts third-person footage into an egocentric view and reconstructs 3D hand skeletons for both hands. It also introduced the Vbot Echo data pipeline and Echo App for collecting demonstrations with ordinary phones, with the tools described as open to everyone.
新智元 · 🔥 0 - EgoX transfers manipulation skills across robot embodiments
Yaru Niu and 21 coauthors submitted the EgoX paper to arXiv on November 12. The framework learns from demonstrations by humans, real robots, and simulated agents, using a Modularized Cross-Embodiment Transformer with Embodiment Dreaming (MXT+). Across 13 task-embodiment pairs, the authors report that cross-embodiment pretraining increased average normalized task progress from 0.63 to 0.80 compared with training from scratch. Under out-of-distribution conditions, average task progress increased from 0.53 to 0.77.
Hugging Face · Papers · 🔥 0 - EgoXperience paper reconstructs camera, scene, hands and objects from egocentric video
An arXiv paper posted on 19 October, "EgoXperience: Learning World-Grounded Egocentric Representations from Human Experience," presents a full-stack pipeline spanning data collection, automatic annotation, unified modeling and benchmarking for reconstructing camera motion, scene geometry and hand-object interaction from egocentric video in one consistent world. At its center is EgoX-Engine, an annotation engine that couples geometrically verified object tracking with SLAM-based world alignment, producing EgoX-Data-6M, a 50-hour dataset of task-driven manipulation and locomotion, from which one hour is selected as the EgoX-Bench benchmark. The authors say their EgoX model takes monocular egocentric video plus first-frame object masks and, in a single forward pass, jointly reconstructs camera, scene, hands and objects in a shared metric world frame; against the strongest evaluated baselines it cuts camera, hand and depth errors by 68.9%, 65.6% and 42.9% and improves object pose scores by 28.0%.
Hugging Face · Papers · 🔥 0
Experience and discussion from the community
Share my EgoX experienceAsk about EgoX
Nobody has shared their experience with EgoX yet.