FastEventDGS:面向单事件相机快速动态场景的可变形高斯泼溅
FastEventDGS: Deformable Gaussian Splatting for Fast Dynamic Scenes from a Single Event Camera
仅用单目事件相机即可完成动态场景的4D重建,其连续相机轨迹参数化与局部图像块事件运动损失可迁移到其他基于事件或稀疏输入的动态高斯泼溅工作中,用于抑制过拟合并提供几何约束。
原文依据 We introduce FastEventDGS, a novel Deformable Gaussian Splatting-based framework that leverages a single event camera for high-fidelity 4D reconstruction.
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论AR/VR 对动态三维资产的需求近期推动了可变形高斯泼溅的普及。然而,传统 RGB 相机受运动模糊和低时序分辨率限制,难以重建高速场景。事件相机提供了有前景的替代方案,但从其稀疏且含噪的输出中重建完整场景仍是一项重大挑战。现有基于事件的方法依赖辅助传感器(如帧相机),从而引入繁琐的硬件与标定难题。我们提出 FastEventDGS,一种新颖的基于可变形高斯泼溅的框架,利用单个事件相机实现高保真 4D 重建。该方法采用连续相机轨迹参数化,并集成两种事件生成模型以提供光度与几何约束。我们进一步提出局部图像块事件运动损失来约束物体运动,有效缓解过拟合。为确保稳健重建,我们在最终阶段采用现成模型进行深度校正并施加噪声正则化项。我们在新的合成与真实世界数据集上展示了稳健结果,凸显了该框架为动态场景高保真 4D 重建提供简化、仅事件解决方案的能力。
英文原文摘要 1322 字符
The demand for dynamic 3D assets in AR/VR has recently popularized Deformable Gaussian Splatting. However, traditional RGB cameras are limited in their ability to reconstruct high-speed scenes due to motion blur and low temporal resolution. While event cameras offer a promising alternative, reconstructing a complete scene from their sparse and noisy output is a significant challenge. Existing event-based methods rely on an auxiliary sensor, such as a frame camera, thereby inducing tedious hardware and calibration challenges.We introduce FastEventDGS, a novel Deformable Gaussian Splatting-based framework that leverages a single event camera for high-fidelity 4D reconstruction. Our method utilizes a continuous camera trajectory parametrization and integrates two event generation models to provide both photometric and geometric constraints. We further propose a local patch event motion loss to constrain object motion, effectively mitigating overfitting. To ensure robust reconstruction, we employ an off-the-shelf model for depth correction and apply noise regularization terms in the final stage. We demonstrate robust results on both new synthetic and real-world datasets, highlighting our framework's ability to provide a simplified, event-only solution for high-fidelity 4D reconstruction in dynamic scenes.