LEGO: lifting-free exocentric-to-egocentric video generation
An arXiv paper proposes LEGO, a method that generates egocentric video from a single exocentric recording without depth estimation, point-cloud lifting or reprojection. Instead, an LVSM-style transformer view synthesizer is fine-tuned to render the egocentric view directly, resolving cross-view correspondence internally; its probabilistic mapping averages each region over candidate source locations, which preserves structure but softens fine texture. The authors argue this trade-off suits a diffusion generator that restores detail during denoising, and that the concentration of the correspondence distribution also yields a per-region confidence used to mask low-confidence areas and guide early layout-forming steps. They report it consistently outperforms the explicit state-of-the-art pipeline and generalizes to other datasets without retraining.
It sketches a simpler route to cross-view video generation that avoids explicit 3D reconstruction steps.
Computer Science > Computer Vision and Pattern Recognition
arXiv:2610.12442 (cs)
[Submitted on 8 Oct 2026]
Title:LEGO: A Lifting-Free Approach for Exocentric-to-Egocentric Video Generation
Authors:Suhwan Cho, Yonwoo Choi, Soongjin Kim, Jicheol Park, Taegyu Lim
View a PDF of the paper titled LEGO: A Lifting-Free Approach for Exocentric-to-Egocentric Video Generation, by Suhwan Cho and 4 other authors