DynamicTree:基于稀疏体素谱的交互式真实树木动画
DynamicTree: Interactive Real Tree Animation via Sparse Voxel Spectrum
把 3DGS 重建的静态树用稀疏体素谱表示成可前馈预测的模态运动,再通过绑定高斯球做形变,为 3DGS 资产的动态化与实时外力交互提供了一条可复用的「谱表示 + 网格驱动」路线。
原文依据 The key success of our approach is the use of a compact sparse voxel spectrum to represent the tree movement.
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论生成动态且可交互的三维树木在虚拟现实、游戏和世界仿真中具有广泛应用。然而,现有方法在为复杂真实树木生成结构一致且逼真的四维运动方面仍面临诸多挑战。本文提出 DynamicTree,这是首个能够为真实树木的 3DGS 重建生成长期、可交互三维运动的框架。与以往基于优化的方法不同,我们的方法以快速前馈的方式生成动态。该方法成功的关键在于使用紧凑的稀疏体素谱来表示树木运动。给定高斯泼溅重建得到的三维树木,我们的流程首先利用稀疏体素谱生成网格运动,然后将高斯球绑定到网格上以进行形变。此外,所提出的稀疏体素谱还可作为外力作用下快速模态分析的基础,从而实现实时交互响应。为训练该模型,我们还引入了 4DTree,这是首个大规模合成四维树木数据集,包含约 8.5k 个带语义标签的动画树木网格以及 100 帧的运动序列。大量实验表明,我们的方法能够实现逼真且响应迅速的树木动画,在视觉质量和计算效率上均显著优于现有方法。
英文原文摘要 1350 字符
Generating dynamic and interactive 3D trees has wide applications in virtual reality, games, and world simulation. However, existing methods still face various challenges in generating structurally consistent and realistic 4D motion for complex real trees. In this paper, we propose DynamicTree, the first framework that can generate long-term, interactive 3D motion for 3DGS reconstructions of real trees. Unlike prior optimization-based methods, our approach generates dynamics in a fast feed-forward manner. The key success of our approach is the use of a compact sparse voxel spectrum to represent the tree movement. Given a 3D tree from Gaussian Splatting reconstruction, our pipeline first generates mesh motion using the sparse voxel spectrum and then binds Gaussians to deform the mesh. Additionally, the proposed sparse voxel spectrum can also serve as a basis for fast modal analysis under external forces, allowing real-time interactive responses. To train our model, we also introduce 4DTree, the first large-scale synthetic 4D tree dataset containing about 8.5k animated tree meshes with semantic labels and 100-frame motion sequences. Extensive experiments demonstrate that our method achieves realistic and responsive tree animations, significantly outperforming existing approaches in both visual quality and computational efficiency.