图像编辑与可控生成 · CVPR2026 ·2026.06.03

RetouchIQ:基于通用奖励的MLLM智能体用于指令式图像修饰

RetouchIQ: MLLM Agents for Instruction-Based Image Retouching with Generalist Reward

Qiucheng Wu、Jing Shi、Simon Jenni、Kushal Kafle、Tianyu Wang、Shiyu Chang 等 7 人

与你有关的部分

提出用强化学习微调的多模态大语言模型作为通用奖励模型,为基于指令的图像编辑提供可验证的奖励信号,可复用于其他需要主观评价的生成任务(如风格化、美学优化)。

原文依据 we propose a generalist reward model, an RL fine-tuned MLLM that evaluates edited results through a set of generated metrics on a case-by-case basis.
可迁移到 基于指令的图像编辑图像修饰强化学习与人类反馈

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

近期多模态大语言模型的进展显示出将视觉-语言推理扩展到专业工具式图像编辑的巨大潜力,能够实现直观且富有创造性的编辑。一个有前景的方向是利用强化学习使MLLM在专业图像编辑软件中推理并执行最优工具使用计划。然而,由于缺乏可靠、可验证且能反映创造性编辑本质主观性的奖励信号,训练仍然具有挑战性。在本工作中,我们提出RetouchIQ,一个通过由通用奖励模型引导的MLLM智能体执行基于指令的可执行图像编辑的框架。RetouchIQ解释用户指定的编辑意图并生成相应的可执行Lightroom调整,将高层美学目标与精确参数控制相衔接。为了超越传统的基于规则的奖励(使用手工设计的度量计算与固定参考图像的相似度),我们提出一个通用奖励模型,即一个经强化学习微调的MLLM,它通过一组按个案生成的度量来评估编辑结果。然后,奖励模型通过多模态推理提供标量反馈,从而以高质量、指令一致的梯度进行强化学习。我们构建了一个包含19万指令-推理对的数据集,并建立了一个基于指令的图像编辑的新基准。实验表明,RetouchIQ在语义一致性和感知质量上均显著优于先前基于MLLM和基于扩散的编辑系统。我们的发现展示了通用奖励驱动的MLLM智能体作为灵活、可解释且可执行的专业图像编辑助手的潜力。

英文原文摘要 1802 字符

Recent advances in multimodal large language models (MLLMs) have shown great potential for extending vision-language reasoning to professional tool-based image editing, enabling intuitive and creative editing. A promising direction is to use reinforcement learning (RL) to enable MLLMs to reason about and execute optimal tool-use plans within professional image-editing software. However, training remains challenging due to the lack of reliable, verifiable reward signals that can reflect the inherently subjective nature of creative editing. In this work, we introduce RetouchIQ, a framework that performs instruction-based executable image editing through MLLM agents guided by a generalist reward model. RetouchIQ interprets user-specified editing intentions and generates corresponding, executable Lightroom adjustments, bridging high-level aesthetic goals with precise parameter control. To move beyond conventional, rule-based rewards that compute similarity against a fixed reference image using handcrafted metrics, we propose a generalist reward model, an RL fine-tuned MLLM that evaluates edited results through a set of generated metrics on a case-by-case basis. Then, the reward model provides scalar feedback through multimodal reasoning, enabling reinforcement learning with high-quality, instruction-consistent gradients. We curate an extended dataset with 190k instruction-reasoning pairs and establish a new benchmark for instruction-based image editing. Experiments show that RetouchIQ substantially improves both semantic consistency and perceptual quality over previous MLLM-based and diffusion-based editing systems. Our findings demonstrate the potential of generalist reward-driven MLLM agents as flexible, explainable, and executable assistants for professional image editing.

标签

会议 CVPR2026
页码 12279-12288
Bibkey
来源 CVF Open Access