自监督与表征学习 · CVPR2026 ·2026.06.03

类增量学习中正负监督的时序不平衡

Temporal Imbalance of Positive and Negative Supervision in Class-Incremental Learning

Jinge Ma、Fengqing Zhu

与你有关的部分

提出时序衰减核来重加权交叉熵中的负监督,可直接嵌入任何类增量学习框架的损失函数,缓解因旧类负监督过强导致的预测偏置与遗忘。

原文依据 propose the Temporal-Adjusted Loss (TAL), which uses a temporal decay kernel to construct a supervision strength vector and dynamically reweight the negative supervision in cross-entropy loss
可迁移到 类增量学习图像分类

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

随着深度学习在视觉任务中的广泛采用,类增量学习(CIL)已成为处理动态演化数据分布的重要范式。然而,CIL 面临灾难性遗忘的核心挑战,通常表现为对新类别的预测偏置。现有方法主要将该偏置归因于任务内类别不平衡,并聚焦于分类器头部的校正。本文强调了一个被忽视的因素——时序不平衡——作为该偏置的关键成因。较早的类别在训练末期受到更强的负监督,导致精确率与召回率不对称。我们建立了时序监督模型,形式化定义了时序不平衡,并提出时序调整损失(TAL),其使用时序衰减核构建监督强度向量,并动态重加权交叉熵损失中的负监督。理论分析表明,TAL 在平衡条件下退化为标准交叉熵,并在不平衡条件下有效缓解预测偏置。大量实验表明,TAL 显著减少遗忘并在多个 CIL 基准上提升性能,凸显了时序建模对于稳定长期学习的重要性。

英文原文摘要 1302 字符

With the widespread adoption of deep learning in visual tasks, Class-Incremental Learning (CIL) has become an important paradigm for handling dynamically evolving data distributions. However, CIL faces the core challenge of *catastrophic forgetting*, often manifested as a prediction bias toward new classes. Existing methods mainly attribute this bias to intra-task class imbalance and focus on corrections at the classifier head. In this paper, we highlight an overlooked factor--*temporal imbalance*--as a key cause of this bias. Earlier classes receive stronger negative supervision toward the end of training, leading to asymmetric precision and recall. We establish a temporal supervision model, formally define temporal imbalance, and propose the Temporal-Adjusted Loss (TAL), which uses a temporal decay kernel to construct a supervision strength vector and dynamically reweight the negative supervision in cross-entropy loss. Theoretical analysis shows that TAL degenerates to standard cross-entropy under balanced conditions and effectively mitigates prediction bias under imbalance. Extensive experiments demonstrate that TAL significantly reduces forgetting and improves performance on multiple CIL benchmarks, underscoring the importance of temporal modeling for stable long-term learning.

标签

会议 CVPR2026
页码 32299-32308
Bibkey
来源 CVF Open Access