面向噪声标签学习的去偏样本选择
Debiased Sample Selection for Learning with Noisy Labels
针对小损失假设下的类别级与实例级确认偏差,MDA 通过调整预测类别分布使其趋于均匀来公平选样,CCS 利用训练动力学剔除疑似真实标签以抑制错误记忆;两者均为即插即用模块,可直接嵌入现有样本选择器或 LNL 流程,用于提升含噪数据训练的图像分类模型。
原文依据 MDA dynamically reshapes the model's predicted class distribution toward uniformity, ensuring more fair sample selection across classes.
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论现有的噪声标签学习(LNL)方法主要依赖小损失技巧,假设低损失样本更可能被正确标注。该策略虽然有效,却受到两种被忽视的确认偏差的影响:(1)类别级确认偏差:来自易学类别的样本往往损失更低,导致过度选择简单样本而忽略困难样本;(2)实例级确认偏差:损失异常低的错误标注样本被误当作干净样本,迫使模型记忆错误标签。这两种偏差在训练过程中不断累积并降低性能。为缓解这些问题,我们提出边缘分布调整(MDA)与候选类别选择(CCS)。MDA 动态地将模型预测的类别分布重塑为更均匀的形态,从而保证跨类别的样本选择更加公平。CCS 利用训练动力学识别可能的真实标签并将其从分类任务中移除,从而防止对错误标注的记忆,同时将弱相关标签转化为有用的监督信号。MDA 与 CCS 均为即插即用模块。大量实验表明,将 MDA 与 CCS 集成到现有样本选择器或先进的 LNL 流程中,在合成噪声的 CIFAR-10/100 以及真实世界数据集(CIFAR-N、Clothing1M、WebVision)上均能持续提升性能,证明了它们在 LNL 方法中的广泛适用性。代码见 https://github.com/Aliinton/DSS。
英文原文摘要 1517 字符
Existing methods for learning with noisy labels (LNL) predominantly rely on the small-loss trick, assuming that low-loss samples are more likely to be correctly labeled. While effective, this strategy suffers from two overlooked confirmation biases: (1) Class-level confirmation bias: samples from easy-to-learn classes tend to have lower losses, leading to over-selection of easy samples while ignore hard ones; (2) Instance-level confirmation bias: mislabeled samples with spuriously low loss are mistakenly treated as clean, forcing the model to memorize wrong labels. Both biases accumulate over training and degrade performance. To mitigate these issues, we propose Marginal Distribution Adjustment (MDA) and Candidate Class Selection (CCS). MDA dynamically reshapes the model's predicted class distribution toward uniformity, ensuring more fair sample selection across classes. CCS leverages training dynamics to identify likely true labels and removes them from the classification task, preventing memorization of incorrect annotations while converting weakly related labels into useful supervision. Both MDA and CCS are plug-and-play modules. Extensive experiments show that integrating MDA and CCS into either existing sample selectors or advanced LNL pipeline consistently enhances performance on both CIFAR-10/100 with synthetic noise and real-world datasets (CIFAR-N, Clothing1M, WebVision), demonstrating their broad applicability in LNL methods. The code is available at https://github.com/Aliinton/DSS.