SAIDO:基于场景感知与重要性引导动态优化的持续学习式AI生成图像泛化检测
SAIDO: Generalizable Detection of AI-Generated Images via Scene-Aware and Importance-Guided Dynamic Optimization in Continual Learning
用 VLLM 做场景感知并动态分配专家模块,配合重要性引导的梯度投影来缓解持续学习中的灾难性遗忘,可直接迁移到任何需要跨域泛化的伪造检测或分布漂移下的分类任务。
原文依据 Importance-Guided Dynamic Optimization Mechanism (IDOM), which optimizes each neuron through an importance-guided gradient projection strategy
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论图像生成技术的广泛滥用引发了安全担忧,推动了AI生成图像检测方法的发展。然而,泛化已成为关键挑战和开放问题:现有方法难以适应真实场景中不断涌现的生成方法和内容类型。为解决该问题,我们提出了一种基于持续学习的场景感知与重要性引导动态优化检测框架(SAIDO)。具体而言,我们设计了基于场景感知的专家模块(SAEM),利用视觉大语言模型(VLLM)动态识别并纳入新场景。针对每个场景动态分配独立的专家模块,使框架能够更好地捕捉场景特定的伪造特征并增强跨场景泛化能力。为在从多种图像生成方法学习时实现模型可塑性与稳定性的有效平衡,我们引入了重要性引导动态优化机制(IDOM),通过重要性引导的梯度投影策略对每个神经元进行优化,从而在模型可塑性与稳定性之间取得有效平衡。在持续学习任务上的大量实验表明,我们的方法在稳定性和可塑性上均优于当前最先进方法,平均检测错误率和遗忘率分别相对降低44.22%和40.57%。在开放世界数据集上,与当前最先进方法相比,平均检测准确率提升9.47%。
英文原文摘要 1530 字符
The widespread misuse of image generation technologies has raised security concerns, driving the development of AI-generated image detection methods. However, generalization has become a key challenge and open problem: existing approaches struggle to adapt to emerging generative methods and content types in real-world scenarios. To address this issue, we propose a Scene-Aware and Importance-Guided Dynamic Optimization detection framework with continual learning (SAIDO). Specifically, we design Scene-Awareness-Based Expert Module (SAEM) that dynamically identifies and incorporates new scenes using VLLMs. For each scene, independent expert modules are dynamically allocated, enabling the framework to capture scene-specific forgery features better and enhance cross-scene generalization. To achieve an effective balance between model plasticity and stability when learning from multiple image generative methods, we introduce Importance-Guided Dynamic Optimization Mechanism (IDOM), which optimizes each neuron through an importance-guided gradient projection strategy, thereby achieving an effective balance between model plasticity and stability. Extensive experiments on continual learning tasks demonstrate that our method outperforms the current SOTA method in both stability and plasticity, achieving 44.22% and 40.57% relative reductions in average detection error rate and forgetting rate, respectively. On open-world datasets, it improves the average detection accuracy by 9.47% compared to the current SOTA method.