自监督与表征学习 · CVPR2026 ·2026.06.03

少样本混合增量学习:数据稀缺与任务不确定下的持续学习

Few-Shot Hybrid Incremental Learning:Continually Learning under Data Scarcity and Task Uncertainty

Yan Li、Yuzhu Shi、Kan Zhou、Shu Zhang、Diqi He、Dingwen Zhang 等 7 人

与你有关的部分

CME-MoE 的条件专家复用与元扩展机制,为视觉模型在少样本、任务不确定的持续数据流中平衡稳定性与可塑性提供了可复用的架构级方案;SEPC 按需扩展原型分类器的思路可直接迁移到视觉分类器的域偏移决策边界建模。

原文依据 we propose the Conditional Meta-Expanding Mixture-of-Experts (CME-MoE), which balances feature-level stability-plasticity trade-off
可迁移到 类增量学习少样本图像分类持续学习

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

现实部署日益增加的复杂性要求智能体在数据稀缺条件下有效适应带有随机增量的非平稳数据流。我们将这一挑战形式化定义为少样本混合增量学习(FSHIL)范式,它揭示了一个关键的稳定性-可塑性困境。现有策略难以解决这一困境:少样本增量学习中的表征冻结可以缓解数据稀缺下的过拟合,但会导致表征可塑性不足;而混合增量学习中的架构扩展为适应提供了可塑性,却在少样本条件下导致过拟合。为此,我们提出条件元扩展混合专家(CME-MoE),通过条件专家复用与元扩展机制在特征层面平衡稳定性-可塑性的权衡。此外,鉴于潜空间中呈现的多域表现,我们引入自扩展原型分类器(SEPC),按需扩展分类以建模复杂的域偏移决策边界。所提方法在五个主流数据集的三种少样本增量学习设定下优于现有最优方法,有效应对数据稀缺与任务不确定性,为现实世界的持续学习提供了稳健的解决方案。

英文原文摘要 1402 字符

The increasing complexity of real-world deployment requires intelligent agents to effectively adapt to non-stationary data streams with stochastic increments under data scarcity. We formally define this challenge as the Few-Shot Hybrid Incremental Learning (FSHIL) paradigm, which reveals a critical stability-plasticity dilemma. Existing strategies struggle to address this dilemma: representation freezing in few-shot incremental learning can mitigate overfitting under data scarcity but leads to insufficient representation plasticity, while architecture expansion in hybrid incremental learning provides plasticity for adaptation but results in overfitting under few-shot conditions. To address this, we propose the Conditional Meta-Expanding Mixture-of-Experts (CME-MoE), which balances feature-level stability-plasticity trade-off through conditional expert reuse and meta-expansion mechanism. Furthermore, recognizing the multi-domain manifestation in the latent space, we introduce the Self-Expanding Prototype Classifier (SEPC), which on-demand expands classification to model complex domain-shifted decision boundaries. The proposed method outperforms existing state-of-the-art methods in three few-shot incremental learning settings across five mainstream datasets, effectively addressing data scarcity and task uncertainty, and providing a robust solution for real-world continual learning.

标签

会议 CVPR2026
页码 32334-32344
Bibkey
来源 CVF Open Access