基于多视图渐进自适应的跨域少样本分割
Cross-Domain Few-Shot Segmentation via Multi-view Progressive Adaptation
把「渐进增强 + 多视图预测一致性」作为无标注目标域自适应的通用手段,可直接迁移到其他跨域密集预测任务(如跨域检测、跨域深度估计)的目标域微调阶段。
原文依据 we propose Multi-view Progressive Adaptation, which progressively adapts few-shot capability to target domains from both data and strategy perspectives
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论跨域少样本分割旨在以少量样本为条件,对数据稀缺域中的类别进行分割。典型方法首先在大规模源域中建立少样本能力,再将其自适应到目标域。然而,由于目标样本的数量与多样性有限,现有方法的性能仍然受限。此外,源域训练模型在目标域中初始较弱的少样本能力,加之显著的域间差异,严重阻碍了目标样本的有效利用,并进一步妨碍了自适应过程。为此,我们提出多视图渐进自适应(MPA),从数据与策略两个视角将少样本能力渐进地自适应到目标域。(i) 在数据视角上,我们引入混合渐进增强,通过累积的强增强逐步生成更多样、更复杂的视图,从而构造难度递增的学习场景。(ii) 在策略视角上,我们设计双链多视图预测,在充分监督下通过串行与并行学习路径充分利用这些渐进复杂的视图。通过在不同且复杂的视图之间联合施加预测一致性约束,MPA 实现了对目标域既鲁棒又准确的自适应。大量实验表明,MPA 有效地将少样本能力自适应到目标域,以较大幅度(+7.0%)超越最优方法。我们的代码已发布于 https://github.com/niejiahao1998/MPA。
英文原文摘要 1579 字符
Cross-Domain Few-Shot Segmentation aims to segment categories in data-scarce domains conditioned on a few exemplars. Typical methods first establish few-shot capability in a large-scale source domain and then adapt it to target domains. However, due to the limited quantity and diversity of target samples, existing methods still exhibit constrained performance. Moreover, the source-trained model's initially weak few-shot capability in target domains, coupled with substantial domain gaps, severely hinders the effective utilization of target samples and further impedes adaptation. To this end, we propose Multi-view Progressive Adaptation, which progressively adapts few-shot capability to target domains from both data and strategy perspectives. (i) From the data perspective, we introduce Hybrid Progressive Augmentation, which progressively generates more diverse and complex views through cumulative strong augmentations, thereby creating increasingly challenging learning scenarios. (ii) From the strategy perspective, we design Dual-chain Multi-view Prediction, which fully leverages these progressively complex views through sequential and parallel learning paths under extensive supervision. By jointly enforcing prediction consistency across diverse and complex views, MPA achieves both robust and accurate adaptation to target domains. Extensive experiments demonstrate that MPA effectively adapts few-shot capability to target domains, outperforming state-of-the-art methods by a large margin (+7.0%). Our code is available at https://github.com/niejiahao1998/MPA.