以视频驱动的提示突破多模态大模型安全
Breaking Multimodal LLM Safety via Video-Driven Prompting
对做多模态大模型安全与对齐的研究者,这篇给出了一个可复用的攻击构造思路:把有害内容与多样、安全邻近的帧交错注入排版视频,利用视频帧多样性降低表征与安全视频的差异,从而绕过系统提示与安全对齐;也可作为评测视频模态安全鲁棒性的红队基线。
原文依据 we propose an algorithm that injects harmful content into typographic videos by interleaving it with diverse, safety-proximal frames
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论多模态大模型(MLLMs)在视觉推理任务上取得了显著进展,已成为 OpenClaw 等新兴 AI 智能体的核心感知引擎。尽管近期研究已提出若干有效的基于图像的越狱方法,但视频模态固有的脆弱性仍是一片基本未被探索的领域。作为弥合这一关键安全缺口的开创性工作,我们证明:在面对预定义系统提示时,视频驱动的越狱攻击比基于图像的对应方法显著更有效、更稳健。具体而言,我们发现,仅将一张有害图像在多个帧上重复以构造视频,即可绕过 MLLMs 的安全机制。我们的分析表明,在模型的表征空间中,不安全视频与安全视频的嵌入相似度高于单张有害图像,因而更难被检测。此外,与包含多样帧的视频相比,由相同帧构成的视频更接近静态图像的处理方式,更容易触发安全防御。受这些发现启发,我们提出一种算法,通过将有害内容与多样、安全邻近的帧交错,把有害内容注入排版视频,从而规避 MLLM 的安全对齐。大量实验表明,在 16 种不同的安全策略下,我们的方法在多个广泛使用的 MLLMs(如 VideoLLaMA-2、Qwen2.5-VL、GPT-4.1 和 Gemini-2.5)上取得了最优的越狱性能。
英文原文摘要 1503 字符
Multimodal Large Language Models (MLLMs) have achieved remarkable progress in visual reasoning tasks, serving as the core perception engines for emerging AI agents like OpenClaw. While recent studies have introduced several effective image-based jailbreak methods, the vulnerabilities inherent in the video modality remain a largely unexplored frontier. As a pioneering effort to bridge this critical safety gap, we demonstrate that video-driven jailbreak attacks are significantly more effective and robust against pre-defined system prompts than their image-based counterparts. Specifically, we find that simply repeating a harmful image across multiple frames to construct a video can bypass the safety mechanisms of MLLMs. Our analysis reveals that unsafe videos are embedded more similarly to safe videos in the model's representation space than individual harmful images, making them harder to detect. Moreover, videos composed of identical frames are processed more like static images and are more likely to trigger safety defenses compared to videos with diverse frames. Motivated by these findings, we propose an algorithm that injects harmful content into typographic videos by interleaving it with diverse, safety-proximal frames, thereby evading MLLM safety alignment. Extensive experiments demonstrate that our approach achieves state-of-the-art jailbreak performance on several widely-used MLLMs (e.g., VideoLLaMA-2, Qwen2.5-VL, GPT-4.1, and Gemini-2.5) under 16 different safety policies.