面向不完整与噪声多视图数据统一聚类的全局图引导与局部图加权对比学习
Global-Graph Guided and Local-Graph Weighted Contrastive Learning for Unified Clustering on Incomplete and Noise Multi-View Data
全局图引导构造新样本对、局部图生成成对权重来加权对比学习,这套「免插补」的图引导对比框架可直接迁移到视觉多视图/多模态表征学习(如多相机、RGB-深度、图像-文本)中处理缺失模态与错配样本。
原文依据 we propose a local-graph weighted contrastive learning, which leverages local neighbors to generate pair-wise weights
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论近年来,对比学习(CL)在挖掘多视图聚类(MVC)的互补信息方面发挥着重要作用,并受到越来越多的关注。然而,真实世界的多视图数据存在数据不完整或噪声问题,导致稀有配对样本或错配样本,严重挑战了基于对比学习的多视图聚类的有效性。也就是说,稀有配对问题阻碍了多视图聚类提取充分的多视图互补信息,而错配问题则使对比学习朝错误方向优化模型。为解决这些问题,我们提出了一个统一的基于对比学习的多视图聚类框架,以增强在不完整与噪声多视图数据上的聚类效果。首先,为缓解稀有配对问题,我们设计了全局图引导的对比学习,其中所有视图样本构建一个全局视图亲和图,以形成新的样本对,从而充分挖掘互补信息。其次,为克服错配问题,我们提出了局部图加权的对比学习,利用局部邻居生成成对权重,以自适应地增强或削弱成对对比学习。我们的方法无需插补,并可集成到一个统一的全局-局部图引导对比学习框架中。在多视图数据的不完整与噪声设置下进行的大量实验表明,与最优方法相比,我们的方法取得了更优的性能。
英文原文摘要 1486 字符
Recently, contrastive learning (CL) plays an important role in exploring complementary information for multi-view clustering (MVC) and has attracted increasing attention. Nevertheless, real-world multi-view data suffer from data incompleteness or noise, resulting in rare-paired samples or mis-paired samples which significantly challenge the effectiveness of CL-based MVC. That is, rare-paired issue prevents MVC from extracting sufficient multi-view complementary information, and mis-paired issue causes contrastive learning to optimize the model in the wrong direction. To address these issues, we propose a unified CL-based MVC framework for enhancing clustering effectiveness on incomplete and noise multi-view data. First, to mitigate the rare-paired issue, we design a global-graph guided contrastive learning, where all view samples construct a global-view affinity graph to form new sample pairs for fully exploring complementary information. Second, to overcome the mis-paired issue, we propose a local-graph weighted contrastive learning, which leverages local neighbors to generate pair-wise weights to adaptively strength or weaken the pair-wise contrastive learning. Our method is imputation-free and can be integrated into a unified global-local graph-guided contrastive learning framework. Extensive experiments on both incomplete and noise settings of multi-view data demonstrate that our method achieves superior performance compared with state-of-the-art approaches.