EgoX-Data-6M
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- EgoXperience paper reconstructs camera, scene, hands and objects from egocentric video
An arXiv paper posted on 19 October, "EgoXperience: Learning World-Grounded Egocentric Representations from Human Experience," presents a full-stack pipeline spanning data collection, automatic annotation, unified modeling and benchmarking for reconstructing camera motion, scene geometry and hand-object interaction from egocentric video in one consistent world. At its center is EgoX-Engine, an annotation engine that couples geometrically verified object tracking with SLAM-based world alignment, producing EgoX-Data-6M, a 50-hour dataset of task-driven manipulation and locomotion, from which one hour is selected as the EgoX-Bench benchmark. The authors say their EgoX model takes monocular egocentric video plus first-frame object masks and, in a single forward pass, jointly reconstructs camera, scene, hands and objects in a shared metric world frame; against the strongest evaluated baselines it cuts camera, hand and depth errors by 68.9%, 65.6% and 42.9% and improves object pose scores by 28.0%.
Hugging Face · Papers · 🔥 0
Experience and discussion from the community
Share my EgoX-Data-6M experienceAsk about EgoX-Data-6M
Nobody has shared their experience with EgoX-Data-6M yet.