针对图像生成模型预训练数据的黑盒成员推理攻击
Black-box Membership Inference Attacks on the Pre-training Data of Image-generation Models
对做扩散模型数据溯源与版权审计的研究者,这篇给出了一个仅依赖黑盒去噪行为的成员推理信号:同时扰动可疑图像与其对应文本指令,观察跨模态去噪响应差异,可在无法访问内部特征的主流闭源平台上判断预训练数据是否被使用。
原文依据 analyzing how a black-box diffusion model denoises a target image and corresponding perturbed textual instructions can reveal more distinctive membership cues
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论基于扩散的图像生成模型的快速发展,引发了人们对涉及人类创作数据的潜在版权与隐私侵权问题的严重担忧。成员推理攻击(MIA)已成为识别模型训练过程中未经授权数据使用的一种有前景的工具。现有方法通常将模型对受扰动可疑图像的去噪能力作为成员状态的指标。然而,此类特征的判别能力高度依赖于模型的记忆程度,并且在应用于暴露程度较低的数据(例如预训练数据)时会显著下降。尽管已有若干方法尝试利用模型内部特征来增强检测,但这些特征在主流闭源图像生成平台中通常无法获取,限制了其实用性。本文表明,分析黑盒扩散模型如何对目标图像及相应受扰动的文本指令进行去噪,可以揭示更具区分度的成员线索。基于这一洞见,我们提出了一种黑盒成员推理攻击框架(名为 SD-MIA),利用跨模态数据扰动机制来检测扩散模型中的预训练数据。我们在一个公开基准数据集和一个新构建的数据集上开展了大量实验,两者均包含分布相同的预训练成员样本与非成员样本。实验结果表明,SD-MIA 相比现有基线取得了更优的性能,包括那些具有访问内部模型特征这一不公平优势的基线。
英文原文摘要 1643 字符
The rapid advancement of diffusion-based image generation models has raised serious concerns regarding potential copyright and privacy infringements involving human-created data. Membership inference attacks (MIAs) have emerged as a promising tool for identifying unauthorized data usage during model training. Existing methods typically assess the ability of model to denoise perturbed suspect images as an indicator of membership status. However, the discriminative power of such features is highly dependent on the degree of model memorization and deteriorates significantly when applied to less exposed data (e.g., pre-training data). Although several methods attempt to enhance detection by leveraging internal model features, these features are generally inaccessible in mainstream closed-source image generation platforms, limiting their practicality. In this paper, we demonstrate that analyzing how a black-box diffusion model denoises a target image and corresponding perturbed textual instructions can reveal more distinctive membership cues. Based on this insight, we propose a black-box membership inference attack framework (named SD-MIA) that leverages a cross-modal data perturbation mechanism to detect pre-training data in diffusion models. We conduct extensive experiments on both a public benchmark dataset and a newly constructed dataset, each comprising pre-training membership and non-membership samples with identical distributions. Experimental results demonstrate that SD-MIA achieves superior performance compared to existing baselines, including those with the unfair advantage of accessing internal model features.