3D 视觉与重建 · CVPR2026 ·2026.06.03

PRIMU:基于基元级误差与覆盖表示的高斯泼溅新视角不确定性估计

PRIMU: Uncertainty Estimation for Novel Views in Gaussian Splatting from Primitive-Based Representations of Error and Coverage

Thomas Gottwald、Edgar Heinert、Peter Stehr、Chamuditha Jayanga Galappaththige、Matthias Rottmann

与你有关的部分

把训练视角的误差与覆盖统计投影到高斯基元上,再渲染成不确定性特征图并用留出数据做像素级回归,这套后处理式不确定性估计可直接用于新视角合成中的主动视角选择与深度可靠性评估。

原文依据 we construct primitive-level representations of error and visibility/coverage from training views
可迁移到 新视角合成深度估计主动视角选择

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

我们提出基于基元的不确定性表示(PRIMU),一种用于高斯泼溅(GS)的后处理式不确定性估计(UE)框架。可靠的不确定性估计对于将 GS 部署到机器人、医学等安全关键领域至关重要。现有方法通常估计高斯基元的方差,并依赖渲染过程获得逐像素不确定性。与之不同,我们从训练视角构建基元级的误差与可见性/覆盖表示,从而捕获可解释的不确定性信息。这些表示通过将依赖视角的训练误差与覆盖统计投影到基元上获得。新视角的不确定性则通过渲染这些基元级表示来推断,产生不确定性特征图,并在留出数据上通过逐像素回归进行聚合。我们分析了不确定性特征图与回归模型的多种组合,以理解它们的交互如何影响预测精度与泛化能力。PRIMU 还通过直接利用这些不确定性特征图,实现了一种有效的主动视角选择策略。此外,我们研究了将泼溅分为前景与背景区域的影响。我们的估计结果与真实误差高度相关,优于最优方法,尤其是在深度不确定性估计和前景物体上。最后,我们的回归模型展现出对未见场景的泛化能力,使得无需额外留出数据即可进行不确定性估计。

英文原文摘要 1507 字符

We introduce Primitive-based Representations of Uncertainty (PRIMU), a post-hoc uncertainty estimation (UE) framework for Gaussian Splatting (GS).Reliable UE is essential for deploying GS in safety-critical domains such as robotics and medicine.Existing approaches typically estimate Gaussian-primitive variances and rely on the rendering process to obtain pixel-wise uncertainties.In contrast, we construct primitive-level representations of error and visibility/coverage from training views, capturing interpretable uncertainty information. These representations are obtained by projecting view-dependent training errors and coverage statistics onto the primitives. Uncertainties for novel views are inferred by rendering these primitive-level representations, producing uncertainty feature maps, which are aggregate through pixel-wise regression on holdout data. We analyze combinations of uncertainty feature maps and regression models to understand how their interactions affect prediction accuracy and generalization.PRIMU also enables an effective active view selection strategy by directly leveraging these uncertainty feature maps.Additionally, we study the effect of separating splatting into foreground and background regions.Our estimates show strong correlations with true errors, outperforming state-of-the-art methods, especially for depth UE and foreground objects.Finally, our regression models show generalization capabilities to unseen scenes, enabling UE without additional holdout data.

标签

会议 CVPR2026
页码 11871-11880
Bibkey
来源 CVF Open Access