3D 视觉与重建 · CVPR2026 ·2026.06.03

RI-Mamba:面向鲁棒文本到形状检索的旋转不变 Mamba

RI-Mamba: Rotation-Invariant Mamba for Robust Text-to-Shape Retrieval

Khanh Nguyen、Dasith de Silva Edirimuni、Ghulam Mubashar Hassan、Ajmal Mian

与你有关的部分

把旋转不变性直接做进 Mamba 状态空间模型的词元序列构造里(全局/局部参考系解耦位姿与几何 + Hilbert 排序),并用特征级线性调制回注朝向嵌入,这套线性时间、对任意朝向鲁棒的 3D 表征可直接迁移到点云分类、分割、配准等下游任务。

原文依据 RI-Mamba defines global and local reference frames to disentangle pose from geometry and uses Hilbert sorting to construct token sequences
可迁移到 文本-3D 形状检索点云表征学习旋转不变点云理解

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

随着虚拟现实与游戏日益普及,3D 资产在数量与多样性上迅速扩张。因此,文本到形状检索对于在大型资源库中进行直观搜索已变得不可或缺。然而,现有方法要求物体处于规范姿态且仅支持少量物体类别,这限制了其在物体可能属于多样类别并以随机朝向出现时的实际适用性。为应对这一挑战,我们提出 RI-Mamba,这是首个面向点云的旋转不变状态空间模型。RI-Mamba 定义全局与局部参考系,以将位姿与几何解耦,并使用 Hilbert 排序构造具有有意义几何结构且保持旋转不变性的词元序列。我们进一步引入一种新策略来计算朝向嵌入,并通过特征级线性调制将其重新注入,从而有效恢复空间上下文并增强模型表达能力。我们的策略与状态空间模型天然兼容,且以线性时间运行。为扩展检索规模,我们采用带有自动三元组生成的跨模态对比学习,使得无需人工标注即可在多样数据集上训练。大量实验表明,RI-Mamba 具有更优的表征能力与鲁棒性,在 OmniObject3D 基准上于任意朝向下超过 200 个物体类别上取得了最优性能。项目主页见 ndkhanh360.github.io/project-rimamba。

英文原文摘要 1534 字符

3D assets have rapidly expanded in quantity and diversity due to the growing popularity of virtual reality and gaming. As a result, text-to-shape retrieval has become essential in facilitating intuitive search within large repositories. However, existing methods require canonical poses and support few object categories, limiting their real-world applicability where objects can belong to diverse classes and appear in random orientations. To address this challenge, we propose RI-Mamba, the first rotation-invariant state-space model for point clouds. RI-Mamba defines global and local reference frames to disentangle pose from geometry and uses Hilbert sorting to construct token sequences with meaningful geometric structure while maintaining rotation invariance. We further introduce a novel strategy to compute orientational embeddings and reintegrate them via feature-wise linear modulation, effectively recovering spatial context and enhancing model expressiveness. Our strategy is inherently compatible with state-space models and operates in linear time. To scale up retrieval, we adopt cross-modal contrastive learning with automated triplet generation, allowing training on diverse datasets without manual annotation. Extensive experiments demonstrate RI-Mamba's superior representational capacity and robustness, achieving state-of-the-art performance on the OmniObject3D benchmark across more than 200 object categories under arbitrary orientations. The project page is available at ndkhanh360.github.io/project-rimamba.

标签

会议 CVPR2026
页码 16834-16844
Bibkey
来源 CVF Open Access