野外场景定位
Scene Grounding in the Wild
把 3DGS 参考模型上的语义特征当作跨域匹配信号,用逆特征优化求解全局 6DoF 位姿与尺度,可在无视觉重叠时把碎片化重建对齐到统一坐标系——对做 SfM/大场景重建、无重叠位姿估计的人是一个可直接复用的对齐模块。
原文依据 formulate alignment as an inverse feature-based optimization scheme that estimates a global 6DoF pose and scale
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论从无结构、野外采集的图像中重建大规模真实场景的精确三维模型,仍是计算机视觉的核心挑战,尤其当输入视图之间几乎没有或完全没有重叠时。在这种情况下,现有重建流程往往产生多个互不连通的部分重建,或错误地把不重叠区域合并为重叠几何。本文提出一个框架,将每个部分重建定位到场景的完整参考模型上,从而在缺乏视觉重叠时也能实现全局一致的对齐。参考模型来自 Google Earth Studio 生成的稠密、地理空间精确的伪合成渲染图。这些渲染图提供完整的场景覆盖,但外观与真实照片差异显著。我们的关键洞见是:尽管存在这一显著的域间差异,两个域仍共享相同的底层场景语义。我们用三维高斯泼溅表示参考模型,为每个高斯附加语义特征,并将对齐表述为一种基于特征的逆优化方案,在保持参考模型固定的同时估计全局 6DoF 位姿与尺度。此外,我们提出 WikiEarth 数据集,将已有的部分三维重建与伪合成参考模型进行配准。实验表明,当以多种经典与基于学习的流程初始化时,我们的方法能持续改善全局对齐,同时缓解最优端到端模型的失效模式。所有代码、数据与训练模型将公开。
英文原文摘要 1617 字符
Reconstructing accurate 3D models of large-scale real-world scenes from unstructured, in-the-wild imagery remains a core challenge in computer vision, especially when the input views have little or no overlap. In such cases, existing reconstruction pipelines often produce multiple disconnected partial reconstructions or erroneously merge non-overlapping regions into overlapping geometry.In this work, we propose a framework that grounds each partial reconstruction to a complete reference model of the scene, enabling globally consistent alignment even in the absence of visual overlap. We obtain reference models from dense, geospatially accurate pseudo-synthetic renderings derived from Google Earth Studio. These renderings provide full scene coverage but differ substantially in appearance from real-world photographs. Our key insight is that, despite this significant domain gap, both domains share the same underlying scene semantics. We represent the reference model using 3D Gaussian Splatting, augmenting each Gaussian with semantic features, and formulate alignment as an inverse feature-based optimization scheme that estimates a global 6DoF pose and scale while keeping the reference model fixed. Furthermore, we introduce the WikiEarth dataset, which registers existing partial 3D reconstructions with pseudo-synthetic reference models. We demonstrate that our approach consistently improves global alignment when initialized with various classical and learning-based pipelines, while mitigating failure modes of state-of-the-art end-to-end models. All code, data, and trained models will be released.