鲁棒性与安全 · CVPR2026 ·2026.06.03

面向预训练点云模型的低秩测试时训练

Low-Rank Test-Time Training for Pre-Trained Point Cloud Models

Ouyangzi Ye、Feifei Shao、Kexin Li、Yawei Luo、Zikai Song、Ping Liu 等 9 人

与你有关的部分

把测试时训练从解码器式辅助目标改为特征层面的掩码一致性对齐,并用 LoRA 低秩单元实现参数高效的自适应,可直接迁移到其他预训练视觉骨干(如点云/图像 Transformer)的 OOD 自适应场景。

原文依据 a lightweight LoRA-based framework that operationalizes this invariance-preserving principle for 3D point cloud classification
可迁移到 3D point cloud classificationout-of-distribution generalizationtest-time adaptation

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

测试时训练(TTT)通过辅助自监督任务提升预训练模型对分布外(OOD)数据的鲁棒性,且无需标注样本。然而,现有 TTT 方法大多依赖基于解码器的辅助目标,存在自适应效率低、与主任务耦合弱的问题。为解决这些局限,我们重新审视测试时训练的机制,通过分析基于掩码的预训练模型来揭示其 OOD 鲁棒性的根本来源。我们的研究表明,其泛化能力源自一种潜变量特征层面的结构不变性,即编码表示在掩码扰动下的一致性。基于这一发现,我们提出 LoTT-PC,一个轻量级的基于 LoRA 的框架,将这种不变性保持原则用于 3D 点云分类。LoTT-PC 由两个主要部分组成:(1)用于参数高效自适应的低秩调制单元;(2)一种置换不变的对齐机制,通过掩码特征对齐来强制表示一致性。在多个基准上的大量实验表明,这一统一设计使预训练点云模型能够在多种 OOD 场景下快速、可靠地自调整,在多种损坏类型下平均准确率优于最优方法 2.7%。

英文原文摘要 1418 字符

Test-time training (TTT) enhances the robustness of pretrained models to out-of-distribution (OOD) data through auxiliary self-supervised tasks, without requiring labeled samples. However, existing TTT methods predominantly rely on decoder-based auxiliary objectives, which suffer from inefficient adaptation and weak coupling with the primary task. To solve these limitations, we revisit the mechanism of test-time training by analyzing masking-based pretrained models to uncover the fundamental source of their OOD robustness. Our investigation reveals that their generalization capability stems from a latent feature-level structural invariance, the consistency of encoded representations under masked perturbations. Building on this insight, we introduce LoTT-PC, a lightweight LoRA-based framework that operationalizes this invariance-preserving principle for 3D point cloud classification. LoTT-PC consists of two main components: (1) low-rank modulation units for parameter-efficient adaptation, and (2) a permutation-invariant alignment mechanism that enforces representation consistency through masked feature alignment. Extensive experiments on multiple benchmarks demonstrate that this unified design enables pretrained point cloud models to self-tune rapidly and reliably across diverse OOD scenarios, outperforming state-of-the-art methods by an average of 2.7% in accuracy under various corruption types.

标签

会议 CVPR2026
页码 31472-31481
Bibkey
来源 CVF Open Access