生成模型与扩散 · CVPR2026 ·2026.06.03

关注生成细节:面向视频扩散模型的直接局部细节偏好优化

Mind the Generative Details: Direct Localized Detail Preference Optimization for Video Diffusion Models

Zitong Huang、Kaidong Zhang、Yukang Ding、Chao Gao、Rui Ding、Ying Chen 等 7 人

与你有关的部分

提出一种基于局部时空区域构造偏好对的后训练对齐方法,仅需单次推理即可生成偏好数据,无需外部评价模型,可复用于视频扩散模型的人类偏好对齐,提升生成保真度和时序一致性。

原文依据 we propose LocalDPO, a novel post-training framework that constructs localized preference pairs from real videos and optimizes alignment at the spatio-temporal region level.
可迁移到 视频生成扩散模型对齐偏好优化

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

将文本到视频扩散模型与人类偏好对齐对于生成高质量视频至关重要。现有的直接偏好优化(DPO)方法依赖于多样本排序和任务特定的评价模型,效率低下且往往产生模糊的全局监督。为解决这些局限,我们提出LocalDPO,一种新颖的后训练框架,它从真实视频中构造局部偏好对,并在时空区域级别优化对齐。我们设计了一个自动化流程来高效收集偏好对数据,每个提示仅需一次推理即可生成偏好对,无需外部评价模型或人工标注。具体而言,我们将高质量真实视频视为正样本,并通过随机时空掩码局部破坏它们,仅使用冻结的基础模型对掩码区域进行图像修复来生成相应的负样本。在训练过程中,我们引入区域感知的DPO损失,将偏好学习限制在损坏区域以实现快速收敛。在Wan2.1和CogVideoX上的实验表明,LocalDPO在视频保真度、时序一致性和人类偏好得分上持续优于其他后训练方法,为视频生成器对齐建立了一种更高效、更细粒度的范式。

英文原文摘要 1346 字符

Aligning text-to-video diffusion models with human preferences is crucial for generating high-quality videos. Existing Direct Preference Otimization (DPO) methods rely on multi-sample ranking and task-specific critic models, which is inefficient and often yields ambiguous global supervision. To address these limitations, we propose LocalDPO, a novel post-training framework that constructs localized preference pairs from real videos and optimizes alignment at the spatio-temporal region level. We design an automated pipeline to efficiently collect preference pair data that generates preference pairs with a single inference per prompt, eliminating the need for external critic models or manual annotation. Specifically, we treat high-quality real videos as positive samples and generate corresponding negatives by locally corrupting them with random spatio-temporal masks and inpainting only the masked regions using the frozen base model. During training, we introduce a region-aware DPO loss that restricts preference learning to corrupted areas for rapid convergence. Experiments on Wan2.1 and CogVideoX demonstrate that LocalDPO consistently improves video fidelity, temporal coherence and human preference scores over other post-training approaches, establishing a more efficient and fine-grained paradigm for video generator alignment.

标签

会议 CVPR2026
页码 35998-36008
Bibkey
来源 CVF Open Access