图像编辑与可控生成 · CVPR2026 ·2026.06.03

面向文本到图像生成的智能体修图器

Agentic Retoucher for Text-To-Image Generation

Shaocheng Shen、Jianfeng Liang、Chunlei Cai、Cong Geng、Huiyu Duan、Xiaoyun Zhang 等 8 人

与你有关的部分

将生成后校正建模为感知-推理-动作的智能体循环,为扩散模型输出提供可定位、可控制的局部修复方案,其感知智能体的上下文显著性学习与推理智能体的渐进偏好对齐可直接迁移到其他图像编辑与质量提升任务。

原文依据 reformulates post-generation correction as a human-like perception-reasoning-action loop
可迁移到 文本到图像生成图像修复图像质量评估缺陷检测

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

文本到图像(T2I)扩散模型如 SDXL 和 FLUX 已实现令人印象深刻的照片级真实感,但肢体、面部、文字等小尺度失真仍然普遍存在。现有精修方法要么执行昂贵的迭代重生成,要么依赖空间定位能力弱的视觉语言模型(VLM),导致语义漂移和不可靠的局部编辑。为弥补这一差距,我们提出 **Agentic Retoucher**,一个分层决策驱动框架,将生成后校正重新表述为类人的感知-推理-动作循环。具体而言,我们设计了(1)一个**感知智能体**,在文本-图像一致性线索下学习上下文显著性以进行细粒度失真定位;(2)一个**推理智能体**,通过渐进式偏好对齐执行人类对齐的推断性诊断;(3)一个**动作智能体**,在用户偏好引导下自适应规划局部图像修复。该设计将感知证据、语言推理和可控校正整合到一个统一的、自校正的决策过程中。为实现细粒度监督和定量评估,我们进一步构建了 **GenBlemish-27K**,一个包含 6K 张 T2I 图像、覆盖 12 个类别的 27K 个标注伪影区域的数据集。大量实验表明,Agentic Retoucher 在感知质量、失真定位和人类偏好对齐方面持续优于最优方法,为自校正且感知可靠的 T2I 生成建立了新范式。

英文原文摘要 1545 字符

Text-to-image (T2I) diffusion models such as SDXL and FLUX have achieved impressive photorealism, yet small-scale distortions remain pervasive in limbs, face, text and so on. Existing refinement approaches either perform costly iterative re-generation or rely on vision-language models (VLMs) with weak spatial grounding, leading to semantic drift and unreliable local edits. To close this gap, we propose **Agentic Retoucher**, a hierarchical decision-driven framework that reformulates post-generation correction as a human-like *perception-reasoning-action* loop.Specifically, we design (1) a **perception agent** that learns contextual saliency for fine-grained distortion localization under text-image consistency cues, (2) a **reasoning agent** that performs human-aligned inferential diagnosis via progressive preference alignment, and (3) an **action agent** that adaptively plans localized inpainting guided by user preference. This design integrates perceptual evidence, linguistic reasoning, and controllable correction into a unified, self-corrective decision process. To enable fine-grained supervision and quantitative evaluation, we further construct **GenBlemish-27K**, a dataset of 6K T2I images with 27K annotated artifact regions across 12 categories.Extensive experiments demonstrate that Agentic Retoucher consistently outperforms state-of-the-art methods in perceptual quality, distortion localization and human preference alignment, establishing a new paradigm for self-corrective and perceptually reliable T2I generation.

标签

会议 CVPR2026
页码 29114-29125
Bibkey
来源 CVF Open Access