自监督与表征学习 · CVPR2026 ·2026.06.03

超越短视对齐:面向在线类增量学习的前瞻优化

Beyond Myopic Alignment: Lookahead Optimization for Online Class-Incremental Learning

Song Lai、Zhe Zhao、Fei Zhu、Ji Cheng、Xi Lin、Qingfu Zhang 等 7 人

与你有关的部分

把「前瞻式优化」引入基于排练的在线类增量学习:沿兼顾可塑性与稳定性的多个方向做前瞻步,再用一阶 Log-Sum-Exp 代理目标强化最差方向,可直接替换视觉分类模型持续学习中的梯度对齐/超梯度更新环节。

原文依据 LOR explores a set of future model states by taking lookahead steps along different directions that balance plasticity and stability
可迁移到 在线类增量学习持续学习图像分类

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

基于排练的方法是现代在线类增量学习(OCIL)的基石,但它们面临一个根本性挑战:当前任务的梯度常与来自记忆缓冲区的排练数据梯度相冲突,从而导致灾难性遗忘。近期工作通过使用超梯度隐式地处理了这一问题,但其内在机制仍鲜为人知。本文给出形式化分析,揭示超梯度是通过将任务特定梯度对齐到一个共同的元目标来缓解遗忘,从而减少梯度冲突。然而我们认为,这种减少冲突的对齐本质上是短视的——它只考虑即时的梯度方向,未能顾及向前一步的损失景观几何。为克服这一局限,我们提出一个新框架:面向排练的前瞻优化(LOR)。LOR 沿兼顾可塑性与稳定性的不同方向执行前瞻步,探索一组未来模型状态,并优化一阶 Log-Sum-Exp(LSE)代理目标,以强调表现最差的采样前瞻方向。来自优化与统计两个视角的理论分析印证了该方法的鲁棒性。在 Seq-CIFAR10、Seq-CIFAR100 与 Seq-TinyImageNet 上的大量实验表明,LOR 显著优于最优方法,为基于排练的 OCIL 建立了一个新的、更鲁棒的范式。

英文原文摘要 1491 字符

Rehearsal-based methods are the cornerstone of modern online class-incremental learning (OCIL), yet they face a fundamental challenge: the gradient of the current task often conflicts with that of the rehearsal data from the memory buffer, leading to catastrophic forgetting. Recent works have implicitly addressed this by using hypergradients, but the underlying mechanism has remained poorly understood. In this paper, we provide a formal analysis revealing that hypergradients mitigate forgetting by aligning task-specific gradients towards a common meta-objective, thereby reducing their conflict. However, we argue that this conflict-reducing alignment is inherently myopic--it only considers the immediate gradient directions, failing to account for the loss landscape geometry one step ahead. To overcome this limitation, we introduce a novel framework: Lookahead Optimization for Rehearsal (LOR). LOR explores a set of future model states by taking lookahead steps along different directions that balance plasticity and stability and optimizes a first-order Log-Sum-Exp (LSE) surrogate to emphasize the worst-performing sampled lookahead directions. Theoretical analysis from both optimization and statistical perspectives corroborates the robustness of our approach. Extensive experiments on Seq-CIFAR10, Seq-CIFAR100, and Seq-TinyImageNet demonstrate that LOR significantly outperforms state-of-the-art methods, establishing a new and more robust paradigm for rehearsal-based OCIL.

标签

会议 CVPR2026
页码 18053-18062
Bibkey
来源 CVF Open Access