生成模型与扩散 · CVPR2026 ·2026.06.03

基于行列式点过程引导策略优化的多样化视频生成

Diverse Video Generation with Determinantal Point Process-Guided Policy Optimization

Tahira Kazimi、Connor Dunlop、Pinar Yanardag

与你有关的部分

把「一组采样的多样性」写成集合级奖励,用 DPP 对冗余样本施加递减收益、用 GRPO 做组内相对反馈,可直接套到任意 T2V/图像扩散模型的微调阶段,解决同一提示词多次采样结果雷同的问题。

原文依据 combines Determinantal Point Processes (DPPs) and Group Relative Policy Optimization (GRPO) theories to enforce explicit reward on diverse generations
可迁移到 文本到视频生成扩散模型强化学习微调生成多样性评测

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

尽管近期的文本到视频(T2V)扩散模型在质量和提示词对齐方面取得了令人印象深刻的表现,但当从单个文本提示词采样多个视频时,它们往往产生多样性较低的输出。我们将这一挑战建模为集合级策略优化问题,目标是训练一个能够覆盖给定提示词下多样化合理结果范围的策略。为此,我们提出 DPP-GRPO,一种面向多样化视频生成的新框架,它结合行列式点过程(DPP)与群体相对策略优化(GRPO)理论,对多样化生成施加显式奖励。我们的目标通过以下方式将多样性转化为显式信号:借助 DPP 对冗余样本施加递减收益,同时借助 GRPO 在候选集合上提供组内反馈。该框架即插即用且与模型无关,能够在视觉外观、相机运动和场景结构上鼓励多样化生成,同时不牺牲提示词保真度或感知质量。我们在 WAN 和 CogVideoX 上实现了该方法,并表明其在 VBench、VideoScore 等最优基准以及人类偏好研究中一致地提升了视频多样性。此外,我们开源了代码,并发布了一个包含 30,000 条多样化提示词的新基准数据集,以支持未来研究。

英文原文摘要 1354 字符

While recent text-to-video (T2V) diffusion models have achieved impressive quality and prompt alignment, they often produce low-diversity outputs when sampling multiple videos from a single text prompt. We tackle this challenge by formulating it as a set-level policy optimization problem, with the goal of training a policy that can cover the diverse range of plausible outcomes for a given prompt. To address this, we introduce DPP-GRPO, a novel framework for diverse video generation generation that combines Determinantal Point Processes (DPPs) and Group Relative Policy Optimization (GRPO) theories to enforce explicit reward on diverse generations. Our objective turns diversity into an explicit signal by imposing diminishing returns on redundant samples (via DPP) while supplies groupwise feedback over candidate sets (via GRPO). Our framework is plug-and-play and model-agnostic, and encourages diverse generations across visual appearance, camera motions, and scene structure without sacrificing prompt fidelity or perceptual quality. We implement our method on WAN and CogVideoX, and show that our method consistently improves video diversity on state-of-the-art benchmarks such as VBench, VideoScore, and human preference studies. Moreover, we release our code and a new benchmark dataset of 30,000 diverse prompts to support future research.

标签

会议 CVPR2026
页码 12839-12848
Bibkey
来源 CVF Open Access