基于来源信息的输入梯度引导从合成数据中学习
Learning from Synthetic Data via Provenance-Based Input Gradient Guidance
利用合成数据生成时记录的来源信息(provenance)作为辅助监督,对输入梯度进行分解与引导,抑制模型对非目标区域的依赖,从而学到更聚焦于目标的判别性表征;该思路可迁移到任何使用合成数据训练、且能获取像素级来源标注的视觉任务中。
原文依据 input gradients are decomposed based on information about target and non-target regions during synthesis, and input gradient guidance is introduced to suppress gradients over non-target regions
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论使用合成数据的学习方法作为一种有效途径受到关注,它能在降低收集成本的同时增加训练数据的多样性,从而提升模型判别的鲁棒性。然而,许多现有方法仅通过训练样本的多样化来间接提升鲁棒性,并未明确教导模型输入空间中哪些区域真正对判别有贡献;因此,模型可能学到由合成偏差和伪影引起的虚假关联。受此局限性的启发,本文提出一种学习框架,利用训练数据合成过程中获得的来源信息——该信息指示输入空间中每个区域是否源自目标物体——作为辅助监督信号,以促进获取聚焦于目标区域的表征。具体而言,基于合成过程中关于目标区域和非目标区域的信息对输入梯度进行分解,并引入输入梯度引导以抑制非目标区域上的梯度。这抑制了模型对非目标区域的依赖,并直接促进了对目标区域判别性表征的学习。实验证明了所提方法在多个任务和模态上的有效性和通用性,包括弱监督目标定位、时空动作定位和图像分类。
英文原文摘要 1480 字符
Learning methods using synthetic data have attracted attention as an effective approach for increasing the diversity of training data while reducing collection costs, thereby improving the robustness of model discrimination. However, many existing methods improve robustness only indirectly through the diversification of training samples and do not explicitly teach the model which regions in the input space truly contribute to discrimination; consequently, the model may learn spurious correlations caused by synthesis biases and artifacts. Motivated by this limitation, this paper proposes a learning framework that uses provenance information obtained during the training data synthesis process, indicating whether each region in the input space originates from the target object, as an auxiliary supervisory signal to promote the acquisition of representations focused on target regions. Specifically, input gradients are decomposed based on information about target and non-target regions during synthesis, and input gradient guidance is introduced to suppress gradients over non-target regions. This suppresses the model's reliance on non-target regions and directly promotes the learning of discriminative representations for target regions. Experiments demonstrate the effectiveness and generality of the proposed method across multiple tasks and modalities, including weakly supervised object localization, spatio-temporal action localization, and image classification.