面向物理合理视频生成的以事件为中心的因果思维链
Chain of Event-Centric Causal Thought for Physically Plausible Video Generation
把物理现象拆成因果相连的事件单元,再用思维链加物理公式约束推理,并转成时序对齐的视觉-语言提示与关键帧,为视频扩散模型提供可复用的因果进展条件注入方式,可直接迁移到需要长时序物理一致性的视频生成任务。
原文依据 we view PPVG as generating a sequence of causally connected and dynamically evolving events
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论物理合理视频生成(PPVG)已成为建模真实世界物理现象的一条有前景的途径。PPVG 需要理解常识知识,这对视频扩散模型而言仍是一项挑战。当前方法借助大语言模型的常识推理能力,将物理概念嵌入提示中。然而,由于缺乏对因果进展进行建模的条件机制,生成模型往往把物理现象渲染为由提示所定义的单一瞬间。本文把 PPVG 视为生成一串因果相连且动态演化的事件序列。为实现这一范式,我们设计了两个关键模块:(1)物理驱动的事件链推理。该模块利用思维链推理,将提示中描述的物理现象分解为多个基本事件单元。为缓解因果歧义,我们嵌入物理公式作为约束,在推理过程中施加确定性的因果依赖关系。(2)过渡感知的跨模态提示(TCP)。为保持事件之间的连续性,该模块将因果事件单元转换为时间对齐的视觉-语言提示。它总结离散的事件描述以获得因果一致的叙述,同时通过交互式编辑逐步合成各个事件的视觉关键帧。在 PhyGenBench 和 VideoPhy 基准上的大量实验表明,我们的框架在多种物理领域生成物理合理视频方面取得了更优的性能。代码见 https://github.com/ZixuanWang0525/CoECT。
英文原文摘要 1637 字符
Physically Plausible Video Generation (PPVG) has emerged as a promising avenue for modeling real-world physical phenomena. PPVG requires an understanding of commonsense knowledge, which remains a challenge for video diffusion models. Current approaches leverage commonsense reasoning capability of large language models to embed physical concepts into prompts. However, generation models often render physical phenomena as a single moment defined by prompts, due to the lack of conditioning mechanisms for modeling causal progression. In this paper, we view PPVG as generating a sequence of causally connected and dynamically evolving events. To realize this paradigm, we design two key modules: (1) Physics-driven Event Chain Reasoning. This module decomposes the physical phenomena described in prompts into multiple elementary event units, leveraging chain-of-thought reasoning. To mitigate causal ambiguity, we embed physical formulas as constraints to impose deterministic causal dependencies during reasoning. (2) Transition-aware Cross-modal Prompting (TCP). To maintain continuity between events, this module transforms causal event units into temporally aligned vision-language prompts. It summarizes discrete event descriptions to obtain causally consistent narratives, while progressively synthesizing visual keyframes of individual events by interactive editing. Comprehensive experiments on PhyGenBench and VideoPhy benchmarks demonstrate that our framework achieves superior performance in generating physically plausible videos across diverse physical domains. Code is available at https://github.com/ZixuanWang0525/CoECT.