生成模型与扩散 · CVPR2026 ·2026.06.03

PHANTOM:联合建模视觉与潜物理动力学的物理注入式视频生成

PHANTOM: Physics-Infused Video Generation via Joint Modeling of Visual and Latent Physical Dynamics

Ying Shen、Jerry Xiong、Tianjiao Yu、Ismini Lourentzou

与你有关的部分

把物理状态的潜变量推断直接嵌入视频生成的条件路径,为做视频生成的人提供了一种无需显式物理参数、可端到端训练的物理一致性约束方式,可直接迁移到世界模型与可控视频预测任务。

原文依据 PHANTOM jointly predicts latent physical dynamics and generates future video frames
可迁移到 视频生成视频预测物理一致性评测

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

近年来,在大规模数据集与强大架构的推动下,生成式视频建模取得了显著进展,产出了令人瞩目的视觉真实感。然而,新出现的证据表明,仅仅扩大数据与模型规模,并不能使这些系统理解支配真实世界动力学的底层物理规律。现有方法往往无法捕捉或强制实现这种物理一致性,从而导致不真实的运动与动力学。在本工作中,我们研究将潜物理属性的推断直接整合进视频生成过程,能否赋予模型生成物理上合理视频的能力。为此,我们提出 PHANTOM,一个物理注入式视频生成模型,它联合建模视觉内容与潜物理动力学。以观测到的视频帧和推断出的物理状态为条件,PHANTOM 联合预测潜物理动力学并生成未来视频帧。PHANTOM 利用一种物理感知的视频表征,作为底层物理的抽象而信息丰富的嵌入,从而在无需显式指定复杂物理动力学与属性集合的情况下,促进物理动力学与视频内容的联合预测。通过将物理感知视频表征的推断直接整合进视频生成过程,PHANTOM 生成的视频序列既具有视觉真实感,又具有物理一致性。在标准视频生成与物理感知基准上的定量与定性结果表明,PHANTOM 不仅在遵循物理动力学方面优于现有方法,而且具有有竞争力的感知保真度。

英文原文摘要 1738 字符

Recent advances in generative video modeling, driven by large-scale datasets and powerful architectures, have yielded remarkable visual realism. However, emerging evidence suggests that simply scaling data and model size does not endow these systems with an understanding of the underlying physical laws that govern real-world dynamics. Existing approaches often fail to capture or enforce such physical consistency, resulting in unrealistic motion and dynamics.In this work, we investigate whether integrating the inference of latent physical properties directly into the video generation process can equip models with the ability to produce physically plausible videos. To this end, we propose PHANTOM, a Physics-Infused Video Generation model that jointly models the visual content and latent physical dynamics. Conditioned on observed video frames and inferred physical states, PHANTOM jointly predicts latent physical dynamics and generates future video frames.PHANTOM leverages a physics-aware video representation that serves as an abstract yet informative embedding of the underlying physics, facilitating the joint prediction of physical dynamics alongside video content without requiring an explicit specification of a complex set of physical dynamics and properties. By integrating the inference of physical-aware video representation directly into the video generation process, PHANTOM produces video sequences that are both visually realistic and physically consistent.Quantitative and qualitative results on both standard video generation and physics-aware benchmarks demonstrate that PHANTOM not only outperforms existing methods in terms of adherence to physical dynamics but also delivers competitive perceptual fidelity.

标签

会议 CVPR2026
页码 11185-11194
Bibkey
来源 CVF Open Access