基于双重投影的闭式概念擦除
Closed-Form Concept Erasure via Double Projections
提供一种无需训练、几秒内即可对预训练扩散/流匹配模型做权重级线性编辑的闭式投影工具,可直接用于概念擦除、风格去除等模型安全编辑场景,并可作为研究生成模型表征方向几何结构的探针。
原文依据 a linear transformation framework that achieves concept erasure analytically, without any training
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论尽管扩散架构等现代生成模型已具备令人印象深刻的创作能力,它们也带来了重要的安全与伦理风险。这些担忧促使人们日益关注概念擦除,即从模型表征中移除不需要的概念的过程。现有方法往往能取得较强的擦除效果,但依赖迭代优化,并可能无意中扭曲无关概念。在本工作中,我们提出一种简单而有原则的替代方案:一个以解析方式实现概念擦除、无需任何训练的线性变换框架。我们的方法通过两个顺序执行的闭式步骤来适配预训练模型:首先计算目标概念的代理投影,其次在已知概念方向的左零空间内施加受约束的变换。这一设计为安全、高效且有理论依据的概念移除提供了确定性强、几何上可解释的流程。在大量实验中,包括在多个 Stable Diffusion 变体以及流匹配模型(FLUX)上进行物体与风格擦除,我们的方法达到或超越了最优方法的性能,同时更忠实地保留了非目标概念。该方法仅需几秒即可应用,为受控的模型编辑提供了一种轻量、即插即用的工具,推动了构建更安全、更负责任的生成模型这一目标。
英文原文摘要 1444 字符
While modern generative models such as diffusion-based architectures have enabled impressive creative capabilities, they also raise important safety and ethical risks. These concerns have led to growing interest in concept erasure, the process of removing unwanted concepts from model representations. Existing approaches often achieve strong erasure performance but rely on iterative optimization and may inadvertently distort unrelated concepts. In this work, we present a simple yet principled alternative: a linear transformation framework that achieves concept erasure analytically, without any training. Our method adapts a pretrained model through two sequential, closed-form steps: first, computing a proxy projection of the target concept, and second, applying a constrained transformation within the left null space of known concept directions. This design yields a deterministic and geometrically interpretable procedure for safe, efficient, and theory-grounded concept removal. Across a wide range of experiments, including object and style erasure on multiple Stable Diffusion variants and the flow-matching model (FLUX), our approach matches or surpasses the performance of state-of-the-art methods while preserving non-target concepts more faithfully. Requiring only a few seconds to apply, it offers a lightweight and drop-in tool for controlled model editing, advancing the goal of safer and more responsible generative models.