3D 视觉与重建 · CVPR2026 ·2026.06.03

PointGS:基于3D高斯泼溅的语义一致无监督3D点云分割

PointGS: Semantic-Consistent Unsupervised 3D Point Cloud Segmentation with 3D Gaussian Splatting

Yixiao Song、Qingyong Li、Wen Wang、Zhicheng Yan

与你有关的部分

利用3D高斯泼溅作为中间表示,将稀疏点云重建为稠密高斯空间,再通过多视图渲染和SAM提取语义,用对比学习蒸馏到3D高斯基元,最后配准回原点云实现无监督分割。这为2D-3D语义迁移提供了一种可复用的技术路线,尤其适合标注稀缺的3D场景理解任务。

原文依据 PointGS leverages 3D Gaussian Splatting as a unified intermediate representation to bridge the discrete-continuous domain gap.
可迁移到 3D点云分割无监督语义分割2D-3D语义迁移

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

无监督点云分割对具身人工智能和自动驾驶至关重要,因为它缓解了全监督方法所需的密集点级标注的过高成本。虽然集成Segment Anything Model (SAM)等2D预训练模型来补充语义信息是一种自然选择,但这种方法面临离散3D点与连续2D图像之间的根本性不匹配。这种不匹配导致不可避免的投影重叠和复杂的模态对齐,从而损害了2D-3D迁移中的语义一致性。为了解决这些限制,本文提出了PointGS,一种简单而有效的无监督3D点云分割流程。PointGS利用3D高斯泼溅作为统一的中间表示来弥合离散-连续域差距。首先通过多视图观测将输入的稀疏点云重建为稠密3D高斯空间,填补空间间隙并编码遮挡关系以消除投影引起的语义混淆。从高斯空间渲染多视图稠密图像,通过SAM提取2D语义掩码,并通过对比学习将语义蒸馏到3D高斯基元,以确保不同视图间语义分配的一致性。通过两步配准将高斯空间与原始点云对齐,并通过在带标签的高斯上进行最近邻搜索来分配点语义。实验表明,PointGS优于最优的无监督方法,在ScanNet-V2上达到+0.9%平均交并比,在S3DIS上达到+2.8%平均交并比。

英文原文摘要 1668 字符

Unsupervised point cloud segmentation is critical for embodied artificial intelligence and autonomous driving, as it mitigates the prohibitive cost of dense point-level annotations required by fully supervised methods. While integrating 2D pre-trained models such as the Segment Anything Model (SAM) to supplement semantic information is a natural choice, yet this approach faces a fundamental mismatch between discrete 3D points and continuous 2D images. This mismatch leads to inevitable projection overlap and complex modality alignment, resulting in compromised semantic consistency across 2D-3D transfer. To address these limitations, this paper proposes PointGS, a simple yet effective pipeline for unsupervised 3D point cloud segmentation. PointGS leverages 3D Gaussian Splatting as a unified intermediate representation to bridge the discrete-continuous domain gap. Input sparse point clouds are first reconstructed into dense 3D Gaussian spaces via multi-view observations, filling spatial gaps and encoding occlusion relationships to eliminate projection-induced semantic conflation. Multi-view dense images are rendered from the Gaussian space, with 2D semantic masks extracted via SAM, and semantics are distilled to 3D Gaussian primitives through contrastive learning to ensure consistent semantic assignments across different views. The Gaussian space is aligned with the original point cloud via two-step registration, and point semantics are assigned through nearest-neighbor search on labeled Gaussians. Experiments demonstrate that PointGS outperforms state-of-the-art unsupervised methods, achieving +0.9% mIoU on ScanNet-V2 and +2.8% mIoU on S3DIS.

标签

会议 CVPR2026
页码 33343-33352
Bibkey
来源 CVF Open Access