MU-GeNeRF:多视图不确定性引导的泛化神经辐射场用于干扰物感知场景
MU-GeNeRF: Multi-view Uncertainty-guided Generalizable Neural Radiance Fields for Distractor-aware Scene
针对泛化神经辐射场在含瞬态干扰物场景下的鲁棒重建问题,提出将干扰物感知分解为源视图不确定性和目标视图不确定性,并集成到异方差重建损失中引导自适应监督加权,为多视图三维重建中的干扰物抑制提供了可复用的不确定性引导思路。
原文依据 we propose MUGeNeRF: a multi-view uncertainty-guided distractor-aware GeNeRF method
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论泛化神经辐射场(GeNeRF)能够从有限数量的视图实现高质量场景重建,并可泛化到未见场景。然而,在真实环境中,瞬态干扰物破坏了跨视图的结构一致性,导致监督信号偏离和重建质量下降。现有的无干扰物神经辐射场方法依赖逐场景优化,并从逐视图重建误差中估计不确定性以去除干扰物,但这对于GeNeRF并不可靠,因为它可能将源视图中不一致的静态结构误判为干扰物。为解决此问题,我们提出MU-GeNeRF:一种多视图不确定性引导的干扰物感知GeNeRF方法,旨在有效缓解GeNeRF在具有瞬态干扰的动态场景中的鲁棒建模挑战。我们显式地将干扰物感知分解为两个互补的不确定性建模任务:源视图不确定性,作为前馈过程中的可迁移先验,捕获由视角变化或动态因素引起的源视图间的结构不一致性;目标视图不确定性,聚焦于瞬态变化引起的观测异常,以推断干扰物的空间分布。这两种不确定性被集成到异方差重建损失中,引导自适应监督加权,提升模型检测和抑制干扰物的能力,并实现更鲁棒的几何建模。大量实验表明,我们的方法不仅优于现有的GeNeRF方法,而且可与场景特定的无干扰物神经辐射场性能相媲美。
英文原文摘要 1663 字符
Generalizable Neural Radiance Fields (GeNeRF) enable high-quality scene reconstruction from a limited number of views and can generalize to unseen scenes. However, in real-world environments, transient distractors disrupt structural consistency across views, leading to deviated supervision signals and degraded reconstruction quality. Existing distractor-free NeRF methods rely on per-scene optimization and they estimate uncertainty from per-view reconstruction errors to remove distractors, but this is unreliable to GeNeRF, because it may misjudge inconsistent static structures from source views as distractors. To address this issue, we propose MUGeNeRF: a multi-view uncertainty-guided distractor-aware GeNeRF method, aim to effectively alleviate GeNeRF's robust modeling challenges in dynamic scenes with transient distractions. We explicitly decompose distractor awareness into two complementary uncertainty modeling tasks: Source-view uncertainty, serving as a transferable prior during the feed-forward process, captures structural inconsistencies across source views caused by viewpoint changes or dynamic factors; Target-view uncertainty focuses on observation anomalies caused by transient changes to infer distractor spatial distribution. These two uncertainties are integrated into a heteroscedastic reconstruction loss that guides adaptive supervision weighting, boosting the model's capability to detect and suppress distractors, and enabling more robust geometric modeling. Extensive experiments demonstrate that our method not only outperforms existing GeNeRF approaches but also rivals the performance of scene-specific distractor-free NeRFs.