RealMe uses video diffusion to make 2K, 4D-consistent volumetric video from sparse captures
A paper titled "RealMe: Immersive Volumetric Video from Minimal Captures," by Chenxu Zhou and co-authors including Xiaowei Zhou, was submitted to arXiv on 21 October 2026 and is slated to appear in SIGGRAPH Asia 2026 Conference Papers. The authors describe RealMe as a unified framework built around a high-resolution video diffusion model that enhances sparse, low-resolution captures into 2K, 4D-consistent video for volumetric reconstruction, using auxiliary data encoded into latents with layout-aware positional embeddings and a latent frequency loss. They report experiments on the public DNA-Rendering benchmark and their own RealVV dataset showing better visual fidelity and 4D consistency than prior methods, though these results are author-reported and not independently replicated.
The work targets a known trade-off in volumetric video, where the authors say dense multi-view capture is costly and impractical while earlier generative approaches suffer limited resolution and 4D inconsistency.
Computer Science > Computer Vision and Pattern Recognition
arXiv:2610.30023 (cs)
[Submitted on 21 Oct 2026]
Title:RealMe: Immersive Volumetric Video from Minimal Captures
Authors:Chenxu Zhou, Zhiyuan Yu, Yudong Jin, Yinji Shentu, Yu Zhang, Jiaming Sun, Xiaowei Zhou
View a PDF of the paper titled RealMe: Immersive Volumetric Video from Minimal Captures, by Chenxu Zhou and 6 other authors