鲁棒性与安全 · CVPR2026 ·2026.06.03

重新审视噪声标签学习:主动遗忘与噪声抑制

Revisiting Learning with Noisy Labels: Active Forgetting and Noise Suppression

Mengmeng Sheng、Zeren Sun、Tao Chen、Jinshan Pan、Yazhou Yao、Fumin Shen

与你有关的部分

提出一种即插即用的正则化框架,通过机器遗忘主动擦除模型已内化的噪声知识,并用负学习抑制后期噪声过拟合,可直接集成到现有噪声标签学习基线中提升鲁棒性。

原文依据 we propose FINE, a fundamentally novel perspective for LNL that unifies active ForgettIng via machine unlearning (MU) and Noise supprEssion via negative learning (NL) within a cohesive framework.
可迁移到 图像分类噪声标签学习鲁棒训练

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

噪声标签学习(LNL)受到越来越多的关注,此前大多数工作遵循依赖干净样本(如样本选择)的范式。然而,这种依赖也带来了内在局限,因为即使对少量噪声样本的过拟合也是不可避免的,这成为进一步改进的主要瓶颈。这一局限促使我们超越单纯的干净样本依赖,探索如何主动遗忘模型已内化的损坏知识,同时抑制进一步的噪声吸收。为此,我们提出了FINE,一种全新的LNL视角,在一个 cohesive 框架内统一了通过机器遗忘(MU)实现的主动遗忘和通过负学习(NL)实现的噪声抑制。具体而言,我们首先揭示了噪声拟合的两个关键阶段:早期泛化学习和后期噪声过拟合。为了主动遗忘早期积累的噪声,我们引入了一个基于MU的模块,采用负交叉熵损失来擦除损坏知识,同时一个利用互补标签的基于NL的模块抑制后期过拟合并减轻对噪声监督的依赖。这些模块作为即插即用的正则化器协同作用,可无缝集成到现有基线中。最后,在合成和真实噪声基准上的大量实验表明,我们的FINE持续提升了鲁棒性和泛化能力。

英文原文摘要 1434 字符

Learning with noisy labels (LNL) has received growing attention, with most prior work following the paradigm of clean-sample reliance (e.g., sample selection). However, this reliance also imposes intrinsic limitations, as overfitting to even a few noisy samples is inevitable, creating a major bottleneck for further improvement. This limitation motivates us to go beyond mere clean-sample reliance and explore how to actively forget corrupted knowledge already internalized by models while suppressing further noise assimilation. To this end, we propose FINE, a fundamentally novel perspective for LNL that unifies active ForgettIng via machine unlearning (MU) and Noise supprEssion via negative learning (NL) within a cohesive framework. Specifically, we first reveal two key stages of noise fitting: early-stage generalized learning and later-stage noise overfitting. To actively forget early-stage noise accumulation, we introduce an MU-based module that employs a negative cross-entropy loss to erase corrupted knowledge, while an NL-based module leveraging complementary labels suppresses later-stage overfitting and mitigates reliance on noisy supervision. These modules act synergistically as plug-and-play regularizers, seamlessly integrating into existing baselines. Finally, extensive experiments on both synthetic and real-world noisy benchmarks demonstrate that our FINE consistently boosts robustness and generalization.

标签

会议 CVPR2026
页码 24792-24802
Bibkey
来源 CVF Open Access