Pantheon360：通过3D感知360度视频扩散驯服数字孪生生成
Pantheon360: Taming Digital Twin Generation via 3D-Aware 360deg Video Diffusion
利用360度全景视频生成和显式3D缓存作为几何脚手架，实现可控相机路径下的高保真、几何一致的场景生成，为数字孪生和仿真提供新思路。
原文依据 We introduce Pantheon360: Taming Digital Twin Generation via 3D-Aware 360deg Video Diffusion, a controllable 360deg video generation framework that synthesizes high-fidelity videos from sparse 360deg inputs.
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论从视频生成完整的数字孪生需要精确的相机控制、全局场景覆盖以及严格的时空一致性——这些约束对于视场角（FoV）有限的透视视频生成器来说仍然具有挑战性。其狭窄的视场角迫使采用长轨迹或多视角轨迹，从而放大了跨视角不一致性和时序漂移。我们认为360度视频生成提供了一种自然的解决方案：全景覆盖简化了轨迹设计，并为保持连贯性提供了强大的全局上下文。我们提出Pantheon360：通过3D感知360度视频扩散驯服数字孪生生成，这是一个可控的360度视频生成框架，能够从稀疏的360度输入合成高保真视频。其核心思想是一个显式的3D缓存，从输入中重建，作为任意用户定义相机路径的几何脚手架。这使得扩散模型能够专注于照片级真实的纹理细化，而3D缓存则强制全局几何一致性。实验表明，Pantheon360实现了卓越的视觉质量和无与伦比的几何连贯性，为下游仿真和数字孪生应用提供了可靠且灵活的360度场景生成。
英文原文摘要 1236 字符
Generating complete digital twins from videos requires precise camera control, global scene coverage, and strict spatial-temporal consistency--constraints that remain challenging for perspective video generators due to their limited field of view (FoV). Their narrow FoV forces long or multi-view trajectories, amplifying cross-view inconsistency and temporal drift.We argue that 360deg video generation offers a natural solution: panoramic coverage simplifies trajectory design and provides strong global context for maintaining coherence. We introduce Pantheon360: Taming Digital Twin Generation via 3D-Aware 360deg Video Diffusion, a controllable 360deg video generation framework that synthesizes high-fidelity videos from sparse 360deg inputs. The key idea is an explicit 3D Cache, reconstructed from the input, which serves as a geometric scaffold for any user-defined camera path. This allows the diffusion model to focus on photorealistic texture refinement while the 3D Cache enforces global geometric consistency.Experiments show that Pantheon360 achieves superior visual quality and unmatched geometric coherence, enabling reliable and flexible 360deg scene generation for downstream simulation and digital-twin applications.