RT-Splatting:基于高斯泼溅的反射-透射联合建模
RT-Splatting: Joint Reflection-Transmission Modeling with Gaussian Splatting
把每个高斯的几何占用与光学不透明度解耦,用同一组高斯基元同时充当表面(捕捉高频反射)与体积(保留清晰透射),并配合镜面感知梯度门控抑制透射分支的误导梯度;做半透明/镜面物体重建与新视角合成时可直接复用这套表示与渲染器设计。
原文依据 disentangles each Gaussian's geometric occupancy from its optical opacity
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论3D 高斯泼溅(3DGS)能够以高视觉质量实现实时新视角合成。然而,现有方法难以处理同时具有复杂反射与清晰透射的半透明镜面表面,往往产生模糊的反射或过度遮挡的透射。为此,我们提出 RT-Splatting,一个将每个高斯的几何占用与其光学不透明度解耦的框架。该分解以单一组高斯基元得到统一的表面-体场景表示。我们的混合渲染器将该表示既解释为表面以捕捉高频反射,又解释为体积以保留清晰透射。为缓解联合优化反射与透射时的歧义,我们引入镜面感知梯度门控,抑制来自高镜面区域进入透射分支的误导性梯度,有效减少干扰性漂浮物。在具有挑战性的半透明场景上的实验表明,RT-Splatting 达到最优性能,在实时渲染下提供高保真反射与清晰透射。此外,我们的分解天然支持灵活的场景编辑。项目主页见 https://sjj118.github.io/RT-Splatting。
英文原文摘要 1304 字符
3D Gaussian Splatting (3DGS) enables real-time novel view synthesis with high visual quality. However, existing methods struggle with semi-transparent specular surfaces that exhibit both complex reflections and clear transmission, often producing blurry reflections or overly occluded transmission. To address this, we present RT-Splatting, a framework that disentangles each Gaussian's geometric occupancy from its optical opacity. This factorization yields a unified surface-volume scene representation with a single set of Gaussian primitives. Our hybrid renderer interprets this representation both as a surface to capture high-frequency reflections and as a volume to preserve clear transmission. To mitigate the ambiguity in jointly optimizing reflection and transmission, we introduce Specular-Aware Gradient Gating, which suppresses misleading gradients from highly specular regions into the transmission branch, effectively reducing distracting floaters. Experiments on challenging semi-transparent scenes show that RT-Splatting achieves state-of-the-art performance, delivering high-fidelity reflections and clear transmission with real-time rendering. Moreover, our factorization naturally enables flexible scene editing. The project page is available at https://sjj118.github.io/RT-Splatting.