神经 Gabor 泼溅:用神经 Gabor 增强高斯泼溅实现高频表面重建
Neural Gabor Splatting: Enhanced Gaussian Splatting with Neural Gabor for High-frequency Surface Reconstruction
用轻量 MLP 增强每个高斯原语以表达内部颜色变化,并基于频率能量进行剪枝与克隆,为高频表面重建提供可复用的原语增强与致密化策略。
原文依据 we propose Neural Gabor splatting, which augments each Gaussian primitive with a lightweight multi-layer perceptron (MLP) that models a wide range of color variations within a single primitive.
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论近年来,3D 高斯泼溅(3DGS)作为三维重建和新视角合成的强大方法迅速兴起。其基于高斯原语的显式表示支持快速训练、实时渲染以及编辑和表面重建等便捷后处理。然而,3DGS 存在一个关键缺陷:对于具有高频外观细节的场景,原语数量会急剧增长,因为每个原语只能表示单一颜色,每个锐利的颜色过渡都需要多个原语。为克服这一限制,我们提出神经 Gabor 泼溅,它为每个高斯原语增加一个轻量级多层感知机(MLP),以在单个原语内建模广泛的颜色变化。为进一步控制原语数量,我们引入频率感知致密化策略,基于频率能量选择不匹配的原语进行剪枝和克隆。我们的方法实现了对具有挑战性的高频表面的精确重建。我们通过在 Mip-NeRF360 等标准基准和高频表面数据集(如棋盘格图案)上的大量实验,以及全面的消融研究,证明了其有效性。
英文原文摘要 1287 字符
Recent years have witnessed the rapid emergence of 3D Gaussian Splatting (3DGS) as a powerful approach for 3D reconstruction and novel view synthesis. Its explicit representation with Gaussian primitives enables fast training, real-time rendering, and convenient post-processing such as editing and surface reconstruction. However, 3DGS suffers from a critical drawback: the number of primitives grows drastically for scenes with high-frequency appearance details, since each primitive can represent only a single color, requiring multiple primitives for every sharp color transition.To overcome this limitation, we propose Neural Gabor splatting, which augments each Gaussian primitive with a lightweight multi-layer perceptron (MLP) that models a wide range of color variations within a single primitive. To further control primitive numbers, we introduce a frequency-aware densification strategy that selects mismatch primitives for pruning and cloning based on frequency energy.Our method achieves accurate reconstruction of challenging high-frequency surfaces. We demonstrate its effectiveness through extensive experiments on both standard benchmarks, such as Mip-NerRF360 and high-frequency surface datasets (e.g., checkered patterns), supported by comprehensive ablation studies.