自监督与表征学习 · CVPR2026 ·2026.06.03

面向不完整多视图多标签分类的跨视图蒸馏与自适应掩码

Cross-View Distillation and Adaptive Masking for Incomplete Multi-View Multi-Label Classification

Yadong Liu、Qiaoqi Li、Yueying Wang、Lunke Fei、Jie Wen

与你有关的部分

跨视图蒸馏把高质量视图的表征作为教师信号对齐低质量视图,配合自适应掩码在融合前剔除不可靠表征,这套「先蒸馏再掩码」的流程可直接迁移到多模态/多视图视觉任务(如多相机、RGB-D、多传感器融合)中处理模态缺失与质量不均衡。

原文依据 we propose the Cross-view Distillation and Adaptive Masking (CDAM) framework
可迁移到 多视图学习多标签图像分类多模态融合

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

尽管现有的不完整多视图多标签学习方法已取得良好性能,但少有研究关注多视图不均衡问题。现有采用梯度调制或交替优化策略的方法虽能缓解该问题,却往往过度简化视图间的交互,导致性能持续不佳。针对这一挑战,我们提出跨视图蒸馏与自适应掩码(CDAM)框架,这是一种面向具有挑战性的双重不完整多视图多标签学习任务、旨在实现均衡多视图优化的新方法。首先,为突破视图的性能瓶颈,我们设计了跨视图蒸馏模块。该模块将低质量的学生表征与高质量的教师表征对齐,从而有效缓解多视图不均衡问题。其次,考虑到蒸馏未必能矫正所有低质量视图,我们引入后续的自适应掩码模块以执行显式的质量评估。该模块在多视图融合之前动态识别并掩蔽任何残留的不可靠表征,从而防止低质量信息破坏融合表征。在六个数据集上与九种最优方法的广泛比较验证了本方法的有效性与稳定性。

英文原文摘要 1383 字符

While existing incomplete multi-view multi-label learning methods have achieved promising performance, few studies have focused on the issue of multi-view imbalance. Existing methods using gradient modulation or alternating optimization strategies alleviate this problem but often oversimplify the interaction between views, resulting in persistently poor performance. In response to the challenge, we propose the Cross-view Distillation and Adaptive Masking (CDAM) framework, a novel approach designed to achieve balanced multi-view optimization for the challenging double incomplete multi-view multi-label learning tasks. First, to overcome the performance bottleneck of views, we design a cross-view distillation module. This module aligns low-quality student representations with high-quality teacher representations, thereby effectively mitigating the multi-view imbalance problem. Second, recognizing that distillation may not rectify all low-quality views, we introduce a subsequent adaptive masking module to perform an explicit quality assessment. This module dynamically identifies and masks out any remaining unreliable representations before multi-view fusion, thus preventing low-quality information from corrupting the fused representation. Extensive comparisons with nine state-of-the-art methods on six datasets validate the effectiveness and stability of our method.

标签

会议 CVPR2026
页码 23051-23060
Bibkey
来源 CVF Open Access