生成模型与扩散 · CVPR2026 ·2026.06.03

首帧是视频内容定制的关键

First Frame Is the Place to Go for Video Content Customization

Jingxi Chen、Zongxia Li、Zhichao Liu、Guangyao Shi、Xiyang Wu、Fuxiao Liu 等 9 人

与你有关的部分

揭示视频生成模型将首帧作为概念记忆缓冲区的隐式机制,为参考引导的视频内容定制提供了一种无需架构改动、仅需20-50个训练样本的少样本微调思路,可复用于个性化视频生成与编辑任务。

原文依据 video models implicitly treat the first frame as a conceptual memory buffer that stores visual entities for later reuse during generation
可迁移到 视频生成视频内容定制参考引导生成

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

首帧在视频生成模型中扮演什么角色?传统上,它被视为视频的时空起点,仅仅是后续动画的种子。在本工作中,我们揭示了一个根本不同的视角:视频模型隐式地将首帧视为一个概念记忆缓冲区,存储视觉实体以便在生成过程中后续重用。利用这一洞见,我们表明,仅使用20-50个训练示例,无需架构更改或大规模微调,就能在多种场景下实现稳健且泛化的视频内容定制。这揭示了视频生成模型在基于参考的视频定制方面一个强大但被忽视的能力。

英文原文摘要 726 字符

What role does the first frame play in video generation models? Traditionally, it's viewed as the spatial-temporal starting point of a video, merely a seed for subsequent animation. In this work, we reveal a fundamentally different perspective: video models implicitly treat the first frame as a conceptual memory buffer that stores visual entities for later reuse during generation. Leveraging this insight, we show that it's possible to achieve robust and generalized video content customization in diverse scenarios, using only 20-50 training examples without architectural changes or large-scale finetuning. This unveils a powerful, overlooked capability of video generation models for reference-based video customization.

标签

会议 CVPR2026
页码 9243-9252
Bibkey
来源 CVF Open Access