自监督与表征学习 · CVPR2026 ·2026.06.03

表征引导的增量适配器微调用于预训练模型类增量学习

Representation-Steered Incremental Adapter-Tuning for Class-Incremental Learning with Pre-Trained Models

Jiarui Zhao、Libo Huang、Xiangqi Li、Zhulin An、Chuanguang Yang、Yu Wang 等 8 人

与你有关的部分

提出单一共享适配器与表征引导损失,避免类增量学习中参数随任务线性增长,并用残差自编码投影器对齐新旧任务特征分布,为视觉模型持续学习提供参数高效且表征一致的方案。

原文依据 RSIAT maintains a single shared adapter for all tasks, eliminating parameter growth during incremental learning.
可迁移到 类增量学习图像分类参数高效微调

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

类增量学习(CIL)旨在开发能够持续学习新类别而不遗忘已学旧类别的模型。近期进展将预训练模型与参数高效微调相结合,取得了有前景的结果。然而,这些方法通常为每个任务分配新的可训练参数,导致模型规模随任务数量线性增长。此外,它们缺乏显式机制来构建跨任务的一致且具有判别性的表征空间。为解决这些局限,我们提出表征引导的增量适配器微调(RSIAT)。RSIAT 为所有任务维护一个单一的共享适配器,消除了增量学习过程中的参数增长。在基础任务中,我们引入表征引导损失,在促进未来任务适应的同时增强判别性特征学习。在增量任务中,基于残差自编码器的投影器对齐新旧任务之间的特征分布,在不过度约束共享适配器的情况下保持表征一致性。在六个 CIL 基准上的大量实验表明,RSIAT 在性能和参数效率上均显著优于最优方法,以极少的可训练参数实现了更优的稳定性-可塑性权衡。代码见 https://github.com/zjrzjrz/RSIAT。

英文原文摘要 1371 字符

Class-Incremental Learning (CIL) aims to develop models to continuously learn new classes without forgetting learned old ones. Recent advances combine pre-trained models with parameter-efficient fine-tuning, achieving promising results. However, these approaches typically allocate new trainable parameters for each task, causing the model size to grow linearly with task number. Moreover, they lack explicit mechanisms to structure a coherent and discriminative representation space across tasks. To address these limitations, we propose Representation-Steered Incremental Adapter Tuning (RSIAT). RSIAT maintains a single shared adapter for all tasks, eliminating parameter growth during incremental learning. In the base task, we introduce a representation-steering loss that enhances discriminative feature learning while facilitating future task adaptation. During incremental tasks, a residual autoencoder-based projector aligns feature distributions between old and new tasks, preserving representation consistency without over-constraining the shared adapter. Extensive experiments on six CIL benchmarks demonstrate that RSIAT significantly outperforms state-of-the-art methods in both performance and parameter efficiency, achieving superior stability-plasticity trade-offs with minimal trainable parameters. Code is available at https://github.com/zjrzjrz/RSIAT.

标签

会议 CVPR2026
页码 18010-18020
Bibkey
来源 CVF Open Access