鲁棒性与安全 · CVPR2026 ·2026.06.03

通过迭代流形偏离放大检测AI生成伪造

Detecting AI-Generated Forgeries via Iterative Manifold Deviation Amplification

Jiangling Zhang、Shuxuan Gao、Bofan Liu、Siqiang Feng、Jirui Huang、Yaxiong Chen 等 7 人

与你有关的部分

把冻结的MAE重建残差当作「真实性先验」,并用粗定位结果反向提示MAE解码器放大可疑区域的重建失败,这一闭环思路可直接迁移到任意需要「偏离正常流形」检测的视觉任务(如异常检测、深度伪造定位)。

原文依据 IFA-Net leverages a frozen Masked Autoencoder (MAE) pretrained on real images as a universal realness prior
可迁移到 AI生成图像检测图像篡改定位图像修复取证

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

高度逼真的AI生成图像的泛滥给数字取证带来了严峻挑战,要求对篡改区域进行精确的像素级定位。现有方法大多学习特定伪造类型的判别性模式,随着编辑技术的演进,难以应对新型篡改。我们提出迭代伪造放大器网络(IFA-Net),它从学习「什么是假的」转向建模「什么是真的」。基于所有篡改都偏离自然图像流形这一原理,IFA-Net 利用在真实图像上预训练的冻结掩码自编码器(MAE)作为通用的真实性先验。我们的框架通过两阶段闭环过程运行:初始的双流分割网络(DSSN)融合原始图像与 MAE 重建残差以进行粗定位,随后任务自适应先验注入(TAPI)模块将这一粗预测转换为引导提示,驱动 MAE 解码器放大可疑区域的重建失败,从而实现精确细化。在四个基于扩散的图像修复基准上的大量实验表明,IFA-Net 相比次优方法在 IoU 上平均提升 6.5%、在 F1 分数上平均提升 8.1%,同时对传统篡改类型展现出强泛化能力。

英文原文摘要 1331 字符

The proliferation of highly realistic AI-generated images poses critical challenges for digital forensics, demanding precise pixel-level localization of manipulated regions. Existing methods predominantly learn discriminative patterns of specific forgeries, struggling with novel manipulations as editing techniques evolve. We propose the Iterative Forgery Amplifier Network (IFA-Net), which shifts from learning "what is fake" to modeling "what is real". Grounded in the principle that all manipulations deviate from the natural image manifold, IFA-Net leverages a frozen Masked Autoencoder (MAE) pretrained on real images as a universal realness prior. Our framework operates through a two-stage closed-loop process: an initial Dual-Stream Segmentation Network (DSSN) fuses the original image with MAE reconstruction residuals for coarse localization, then a Task-Adaptive Prior Injection (TAPI) module converts this coarse prediction into guiding prompts that steer the MAE decoder to amplify reconstruction failures in suspicious regions, enabling precise refinement. Extensive experiments on four diffusion-based inpainting benchmarks show that IFA-Net achieves an average improvement of 6.5% in IoU and 8.1% in F1-score over the second-best method, while demonstrating strong generalization to traditional manipulation types.

标签

会议 CVPR2026
页码 35494-35503
Bibkey
来源 CVF Open Access