从无位姿脉冲流进行三维高斯泼溅
3D Gaussian Splatting from Unposed Spike Stream
把脉冲相机的概率模型推广到关键帧选择,使无位姿(unposed)脉冲流也能联合优化相机轨迹与 3DGS 场景,为高速动态场景重建提供了一条不依赖外部位姿先验的流程。
原文依据 the first framework that reconstructs high-speed 3D scenes from unposed captures of bio-inspired high-temporal-resolution spike cameras
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论三维高斯泼溅(3D Gaussian Splatting,3DGS)凭借其出色性能显著推进了三维重建。然而,它对清晰图像和精确相机位姿先验的依赖,限制了其在高速度场景中的有效性。近期研究引入了脉冲相机——一种具有高时序分辨率的仿生传感器——以增强此类条件下的 3DGS。尽管基于脉冲的方法降低了对清晰图像的需求,但由于观测不稳定和视觉纹理匮乏,它们仍难以实现精确的相机姿态估计。为应对这些挑战,我们提出 Nope-SGS,这是首个从仿生高时序分辨率脉冲相机的无位姿采集数据中重建高速三维场景的框架。为实现鲁棒的三维重建与姿态估计,我们首先从概率视角重新表述脉冲模型,并将其应用扩展到关键帧选取,从而有效缓解脉冲流引起的不稳定性。在此基础上,我们设计了一个渐进式优化框架,以促进快速三维重建。实验结果表明,在具有挑战性的高速场景下,与最优方法相比,我们的方法峰值信噪比最高提升 7.4 dB,绝对轨迹误差(ATE)降低 40%,同时保持基于脉冲的方法中最快的重建速度。
英文原文摘要 1380 字符
3D Gaussian Splatting (3DGS) has significantly advanced 3D reconstruction with its impressive performance. However, its reliance on sharp images and precise camera pose priors limits its effectiveness in high-speed scenarios. Recent advances have integrated spike cameras, a bio-inspired sensor with high temporal resolution, to enhance 3DGS in such conditions. Although spike-based methods reduce the need for sharp images, they still face challenges in achieving precise camera pose estimation due to unstable observations and visual texture deficiency. To address these challenges, we propose Nope-SGS, the first framework that reconstructs high-speed 3D scenes from unposed captures of bio-inspired high-temporal-resolution spike cameras. To achieve robust 3D reconstruction and pose estimation, we first reformulate the spike model from a probabilistic perspective and extend its application to keyframing, effectively alleviating the instability caused by spike streams. Building upon this foundation, we devise a progressive optimization framework to facilitate swift 3D reconstruction. The experimental results demonstrate that our method achieves up to 7.4 dB higher PSNR and 40% lower Absolute Trajectory Error (ATE) compared to state-of-the-art methods under challenging high-speed scenarios while maintaining the fastest reconstruction speed among spike-based methods.