表征引导的增量适配器微调用于预训练模型类增量学习
Representation-Steered Incremental Adapter-Tuning for Class-Incremental Learning with Pre-Trained Models
提出单一共享适配器与表征引导损失,避免类增量学习中参数随任务线性增长,并用残差自编码投影器对齐新旧任务特征分布,为视觉模型持续学习提供参数高效且表征一致的方案。
原文依据 RSIAT maintains a single shared adapter for all tasks, eliminating parameter growth during incremental learning.
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论类增量学习(CIL)旨在开发能够持续学习新类别而不遗忘已学旧类别的模型。近期进展将预训练模型与参数高效微调相结合,取得了有前景的结果。然而,这些方法通常为每个任务分配新的可训练参数,导致模型规模随任务数量线性增长。此外,它们缺乏显式机制来构建跨任务的一致且具有判别性的表征空间。为解决这些局限,我们提出表征引导的增量适配器微调(RSIAT)。RSIAT 为所有任务维护一个单一的共享适配器,消除了增量学习过程中的参数增长。在基础任务中,我们引入表征引导损失,在促进未来任务适应的同时增强判别性特征学习。在增量任务中,基于残差自编码器的投影器对齐新旧任务之间的特征分布,在不过度约束共享适配器的情况下保持表征一致性。在六个 CIL 基准上的大量实验表明,RSIAT 在性能和参数效率上均显著优于最优方法,以极少的可训练参数实现了更优的稳定性-可塑性权衡。代码见 https://github.com/zjrzjrz/RSIAT。
英文原文摘要 1371 字符
Class-Incremental Learning (CIL) aims to develop models to continuously learn new classes without forgetting learned old ones. Recent advances combine pre-trained models with parameter-efficient fine-tuning, achieving promising results. However, these approaches typically allocate new trainable parameters for each task, causing the model size to grow linearly with task number. Moreover, they lack explicit mechanisms to structure a coherent and discriminative representation space across tasks. To address these limitations, we propose Representation-Steered Incremental Adapter Tuning (RSIAT). RSIAT maintains a single shared adapter for all tasks, eliminating parameter growth during incremental learning. In the base task, we introduce a representation-steering loss that enhances discriminative feature learning while facilitating future task adaptation. During incremental tasks, a residual autoencoder-based projector aligns feature distributions between old and new tasks, preserving representation consistency without over-constraining the shared adapter. Extensive experiments on six CIL benchmarks demonstrate that RSIAT significantly outperforms state-of-the-art methods in both performance and parameter efficiency, achieving superior stability-plasticity trade-offs with minimal trainable parameters. Code is available at https://github.com/zjrzjrz/RSIAT.