图像编辑与可控生成 · CVPR2026 ·2026.06.03

擦除数千个概念:面向文本到图像扩散模型的可扩展且实用的概念擦除

Erasing Thousands of Concepts: Towards Scalable and Practical Concept Erasure for Text-to-Image Diffusion Models

Hoigi Seo、Byung Hyun Lee、Jaehyun Cho、Sungjin Lim、Se Young Chun

与你有关的部分

提出基于t分布混合模型和最优传输的概念擦除框架,可精确定位并擦除文本嵌入中的目标概念,同时保持其他概念生成质量,为扩散模型的安全可控生成提供可扩展方案。

原文依据 Concept erasure has emerged as a mitigation strategy, yet existing approaches struggle to balance scalability, precision, and robustness
可迁移到 文本到图像生成概念擦除可控生成

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

大规模文本到图像(T2I)扩散模型能生成高保真图像,但由于其可能重现不良内容(如受版权保护的内容),带来了安全风险。概念擦除已成为一种缓解策略,但现有方法难以平衡可扩展性、精确性和鲁棒性,这限制了它们仅能擦除数百个概念。为解决这些限制,我们提出了擦除数千个概念(ETC)框架,能够擦除数千个概念同时保持生成质量。我们的方法首先通过学生t分布混合模型(tMM)对低秩概念分布进行建模。它通过仿射最优传输实现目标概念的精准擦除,并通过锚定目标概念分布的边界来保留其他概念,而无需预定义锚框概念。然后,我们训练一个基于混合专家(MoE)的模块,称为MoEraser,该模块移除目标嵌入同时保留锚框嵌入。通过在文本嵌入投影器中注入噪声并微调MoEraser进行恢复,我们的框架对白盒攻击(如模块移除)具有鲁棒性。在超过2000个概念、跨异构领域和扩散模型上的大量实验表明,在大规模概念擦除方面达到了最优的可扩展性和精确性。

英文原文摘要 1379 字符

Large-scale text-to-image (T2I) diffusion models deliver remarkable visual fidelity but pose safety risks due to their capacity to reproduce undesirable content, such as copyrighted ones. Concept erasure has emerged as a mitigation strategy, yet existing approaches struggle to balance scalability, precision, and robustness, which restricts their applicability to erasing only a few hundred concepts. To address these limitations, we present Erasing Thousands of Concepts (ETC), a scalable framework capable of erasing thousands of concepts while preserving generation quality. Our method first models low-rank concept distributions via a Student's t-distribution Mixture Model (tMM). It enables pin-point erasure of target concepts via affine optimal transport while preserving others by anchoring the boundaries of target concept distributions without pre-defined anchor concepts. We then train a Mixture-of-Experts (MoE)-based module, termed MoEraser, which removes target embeddings while preserving the anchor embeddings. By injecting noise into the text embedding projector and fine-tuning MoEraser for recovery, our framework achieves robustness to white-box attack such as module removal. Extensive experiments on over 2,000 concepts across heterogeneous domains and diffusion models demonstrate state-of-the-art scalability and precision in large-scale concept erasure.

标签

会议 CVPR2026
页码 10262-10272
Bibkey
来源 CVF Open Access