鲁棒性与安全 · CVPR2026 ·2026.06.03

当理解成为风险:新兴图像生成范式中的真实性与安全风险

When Understanding Becomes a Risk: Authenticity and Safety Risks in the Emerging Image Generation Paradigm

Ye Leng、Junjie Chu、Mingjie Li、Chenhao Lin、Chao Shen、Michael Backes 等 8 人

与你有关的部分

论文系统对比了MLLM与扩散模型在生成不安全内容和虚假图像上的安全风险,并揭示现有虚假图像检测器对MLLM生成图像识别困难、且可通过更长描述性输入绕过。对视觉安全研究者而言,这提示需要针对MLLM生成范式设计新的检测与防御方法,并重新评估现有检测器的泛化性。

原文依据 MLLM-generated images are also notably harder to identify.
可迁移到 虚假图像检测不安全内容生成检测多模态安全评测

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

近期,多模态大语言模型(MLLMs)已成为语言与图像生成的统一范式。与扩散模型相比,MLLMs 具备更强的语义理解能力,能够处理更复杂的文本输入并理解更丰富的上下文含义。然而,这种增强的语义能力也可能引入新的、潜在更大的安全风险。以扩散模型为参照点,我们从两个维度系统分析和比较新兴 MLLMs 的安全风险:不安全内容生成和虚假图像合成。在多个不安全生成基准数据集上,我们观察到 MLLMs 倾向于比扩散模型生成更多不安全图像。这一差异部分源于扩散模型往往无法解读抽象提示,产生损坏的输出,而 MLLMs 能够理解这些提示并生成不安全内容。对于当前先进的虚假图像检测器,MLLM 生成的图像也明显更难识别。即使使用 MLLMs 特定数据重新训练检测器,仍可通过向 MLLMs 提供更长、更具描述性的输入来绕过检测。我们的测量表明,前沿生成范式 MLLMs 的新兴安全风险尚未得到充分认识,对现实世界安全构成了新挑战。

英文原文摘要 1388 字符

Recently, multimodal large language models (MLLMs) have emerged as a unified paradigm for language and image generation. Compared with diffusion models, MLLMs possess a much stronger capability for semantic understanding, enabling them to process more complex textual inputs and comprehend richer contextual meanings. However, this enhanced semantic ability may also introduce new and potentially greater safety risks. Taking diffusion models as a reference point, we systematically analyze and compare the safety risks of emerging MLLMs along two dimensions: unsafe content generation and fake image synthesis. Across multiple unsafe generation benchmark datasets, we observe that MLLMs tend to generate more unsafe images than diffusion models. This difference partly arises because diffusion models often fail to interpret abstract prompts, producing corrupted outputs, whereas MLLMs can comprehend these prompts and generate unsafe content. For current advanced fake image detectors, MLLM-generated images are also notably harder to identify. Even when detectors are retrained with MLLMs-specific data, they can still be bypassed by simply providing MLLMs with longer and more descriptive inputs. Our measurements indicate that the emerging safety risks of the cutting-edge generative paradigm, MLLMs, have not been sufficiently recognized, posing new challenges to real-world safety.

标签

会议 CVPR2026
页码 39372-39382
Bibkey
来源 CVF Open Access