图像编辑与可控生成 · CVPR2026 ·2026.06.03

CamDirector:面向长期连贯的视频轨迹编辑

CamDirector: Towards Long-Term Coherent Video Trajectory Editing

Kejia Yin、Zhihao Shi、Weilin Wan、Yuhongze Zhou、Yuanhao Yu、Xinxin Zuo 等 8 人

与你有关的部分

用混合 warping(静态区域渐进融合进 world cache 再按目标位姿渲染、动态区域直接 warp)生成全局一致的粗帧作为扩散精修的条件,可迁移到任何需要精确相机控制与长程一致性的视频生成/新视角合成任务。

原文依据 static regions are progressively fused into a world cache then rendered to target camera poses, while dynamic regions are directly warped
可迁移到 视频相机轨迹编辑新视角视频合成视频修复长视频生成

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

视频(相机)轨迹编辑旨在合成遵循用户自定义相机路径的新视频,同时保持场景内容并对先前不可见区域进行合理的图像修复,从而将业余素材升级为专业风格的视频。现有视频轨迹编辑方法难以实现精确的相机控制与长程一致性,因为它们要么通过容量有限的嵌入注入目标位姿,要么依赖单帧变形并仅在视频扩散模型中隐式地进行跨帧聚合。为解决这些问题,我们提出一个新的视频轨迹编辑框架:1)通过混合变形方案显式地聚合整个源视频的信息。具体而言,静态区域被渐进地融合进一个世界缓存,随后渲染到目标相机位姿,而动态区域则被直接变形;二者的融合产生全局一致的粗帧以引导精修。2)借助历史引导的自回归扩散模型,将视频片段与其历史联合处理,同时世界缓存被增量更新以强化已修复的内容,从而实现长期的时序连贯性。最后,我们提出 iPhone-PTZ,一个具有多样相机运动与大幅轨迹变化的新视频轨迹编辑基准,并以更少的参数取得了最优性能。

英文原文摘要 1309 字符

Video (camera) trajectory editing aims to synthesize new videos that follow user-defined camera paths while preserving scene content and plausibly inpainting previously unseen regions, upgrading amateur footage into professionally styled videos. Existing VTE methods struggle with precise camera control and long-range consistency because they either inject target poses through a limited-capacity embedding or rely on single-frame warping with only implicit cross-frame aggregation in video diffusion models. To address these issues, we introduce a new VTE framework that 1) explicitly aggregates information across the entire source video via a hybrid warping scheme. Specifically, static regions are progressively fused into a world cache then rendered to target camera poses, while dynamic regions are directly warped; their fusion yields globally consistent coarse frames that guide refinement.2) processes video segments jointly with their history via a history-guided autoregressive diffusion model, while the world cache is incrementally updated to reinforce already inpainted content, enabling long-term temporal coherence. Finally, we present iPhone-PTZ, a new VTE benchmark with diverse camera motions and large trajectory variations, and achieve state-of-the-art performance with fewer parameters.

标签

会议 CVPR2026
页码 32683-32692
Bibkey
来源 CVF Open Access