图像编辑与可控生成 · CVPR2026 ·2026.06.03

FFP-300K:扩展首帧传播以实现可泛化的视频编辑

FFP-300K: Scaling First-Frame Propagation for Generalizable Video Editing

Xijie Huang、Chengming Xu、Donghao Luo、Xiaobin Hu、Peng Tang、Xu Peng 等 9 人

与你有关的部分

提出无需运行时引导的首帧传播视频编辑框架,其 AST-RoPE 通过动态重映射位置编码解耦外观与运动参考,可迁移到任何以首帧为条件的视频生成/编辑模型;同时 300K 高质量视频对数据集为训练鲁棒时序先验提供了数据基础。

原文依据 we introduce Adaptive Spatio-Temporal RoPE (AST-RoPE), which dynamically remaps positional encodings to disentangle appearance and motion references
可迁移到 视频编辑可控视频生成首帧条件生成

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

首帧传播(FFP)为可控视频编辑提供了一种有前景的范式,但现有方法受制于对繁琐的运行时引导的依赖。我们将这一局限的根源归结为当前训练数据的不足:这些数据往往时长过短、分辨率偏低,且缺乏教会模型鲁棒时序先验所需的任务多样性。为弥补这一基础性的数据缺口,我们首先提出 FFP-300K,这是一个新的大规模数据集,包含 30 万对高保真视频对,分辨率为 720p、长度为 81 帧,通过一套原则性的双轨流程构建,覆盖多样的局部与全局编辑。基于该数据集,我们提出了一个面向真正无需引导的 FFP 的新框架,解决了在保持首帧外观与保留源视频运动之间的关键矛盾。在架构层面,我们引入自适应时空 RoPE(AST-RoPE),它动态重映射位置编码,以解耦外观参考与运动参考。在目标层面,我们采用自蒸馏策略,其中恒等传播任务充当强正则化项,确保长期时序稳定性并防止语义漂移。在 EditVerseBench 基准上的综合实验表明,我们的方法显著优于现有的学术与商业模型,相较这些竞争者分别获得约 0.2 的 PickScore 提升与 0.3 的 VLM 分数提升。项目主页为 ffp-300k.github.io。

英文原文摘要 1494 字符

First-Frame Propagation (FFP) offers a promising paradigm for controllable video editing, but existing methods are hampered by a reliance on cumbersome run-time guidance. We identify the root cause of this limitation as the inadequacy of current training datasets, which are often too short, low-resolution, and lack the task diversity required to teach robust temporal priors. To address this foundational data gap, we first introduce FFP-300K, a new large-scale dataset comprising 300K high-fidelity video pairs at 720p resolution and 81 frames in length, constructed via a principled two-track pipeline for diverse local and global edits. Building on this dataset, we propose a novel framework designed for true guidance-free FFP that resolves the critical tension between maintaining first-frame appearance and preserving source video motion. Architecturally, we introduce Adaptive Spatio-Temporal RoPE (AST-RoPE), which dynamically remaps positional encodings to disentangle appearance and motion references. At the objective level, we employ a self-distillation strategy where an identity propagation task acts as a powerful regularizer, ensuring long-term temporal stability and preventing semantic drift. Comprehensive experiments on the EditVerseBench benchmark demonstrate that our method significantly outperforming existing academic and commercial models by receiving about 0.2 PickScore and 0.3 VLM score improvement against these competitors. The project is at ffp-300k.github.io.

标签

会议 CVPR2026
页码 23172-23181
Bibkey
来源 CVF Open Access