ALIVE: Interaction-Aligned Object Insertion for First-Frame-Guided Video Editing
The paper introduces ALIVE, a framework that makes inserted objects “alive” by having them interact coherently with the source video — for example being picked up or manipulated — using an edited first frame and an instruction that names only the added object. The authors curate 35,800 editing pairs built from 3D-rendered, model-generated and real-world videos plus general editing pairs from ROSE, each pair differing only in whether the target object is present, and train a VLM to predict interaction guidance from the same inputs. Without VLM guidance, ALIVE improves Overall over the strongest evaluated baseline by 43.9% on the ALIVE-interaction benchmark and 4.4% on the general video object insertion benchmark; VLM-predicted guidance adds a further 0.95 points without extra user input.
The hard part of object insertion is shifting from placing an object to having it participate in the action, and this work offers both a data recipe and a unified evaluation protocol.
Computer Science > Computer Vision and Pattern Recognition
arXiv:2610.08779 (cs)
[Submitted on 6 Oct 2026]
Title:ALIVE: Interaction-Aligned Object Insertion for First-Frame-Guided Video Editing
Authors:Zhenghong Zhou, Zhe Lin, Jiebo Luo, Yuqian Zhou
View a PDF of the paper titled ALIVE: Interaction-Aligned Object Insertion for First-Frame-Guided Video Editing, by Zhenghong Zhou and 3 other authors