图像编辑与可控生成 · CVPR2026 ·2026.06.03

重新思考文生视觉生成中推理时扩展的提示词设计

Rethinking Prompt Design for Inference-time Scaling in Text-to-Visual Generation

Subin Kim、Sangwoo Mo、Mamshad Nayeem Rizve、Yiran Xu、Difan Liu、Jinwoo Shin 等 7 人

与你有关的部分

把推理时扩展从「多采样视觉结果」扩展到「同步改写提示词」,并给出元素级事实校验器作为对齐反馈信号;做文生图/文生视频时可直接复用该「生成—诊断失败模式—重写提示词—再生成」的闭环,替代单纯增加采样步数或随机种子。

原文依据 we propose Prompt Redesign for Inference-time Scaling, coined PRIS, a framework that adaptively revises the prompt during inference
可迁移到 text-to-image generationtext-to-video generationprompt engineeringgenerated image evaluation

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

在文生视觉生成中,实现用户意图与生成视觉内容之间的精确对齐仍是一项核心挑战,因为单次尝试往往无法产生期望的输出。为应对这一问题,已有方法主要对视觉生成过程进行扩展(例如增加采样步数或随机种子),但这很快会导致质量进入平台期。该局限源于提示词适配并未随生成样本数量的增长而同步扩展。为此,我们提出用于推理时扩展的提示词重设计框架,简称 PRIS,该框架在推理阶段根据被扩展的视觉生成结果自适应地修改提示词。PRIS 的核心思想是审查已生成的视觉内容,识别跨多个视觉结果反复出现的失败模式,并据此重设计提示词,然后用修改后的提示词重新生成视觉内容。为给提示词修改提供精确的对齐反馈,我们引入一种新的验证器——元素级事实校正,它在细粒度层面评估提示词属性与生成视觉内容之间的对齐,从而实现比整体性度量更准确、更具可解释性的评估。在文生图像与文生视频基准上的大量实验证明了本方法的有效性,其中包括在 VBench 2.0 上取得 15% 的提升。这些结果表明,联合扩展提示词与视觉内容,是在推理阶段充分利用扩展定律的关键。

英文原文摘要 1459 字符

Achieving precise alignment between user intent and generated visuals remains a central challenge in text-to-visual generation, as a single attempt often fails to produce the desired output. To handle this, prior approaches mainly scale the visual generation process (e.g., increasing sampling steps or seeds), but this quickly leads to a quality plateau. This limitation arises because prompt adaptation does not scale along with the increasing population of generated samples. To address this, we propose Prompt Redesign for Inference-time Scaling, coined PRIS, a framework that adaptively revises the prompt during inference in response to the scaled visual generations. The core idea of PRIS is to review the generated visuals, identify recurring failure patterns across visuals, and redesign the prompt accordingly before regenerating the visuals with the revised prompt. To provide precise alignment feedback for prompt revision, we introduce a new verifier, element-level factual correction, which evaluates the alignment between prompt attributes and generated visuals at a fine-grained level, achieving more accurate and interpretable assessments than holistic measures. Extensive experiments on both text-to-image and text-to-video benchmarks demonstrate the effectiveness of our approach, including a 15% gain on VBench 2.0. These results highlight that jointly scaling prompts and visuals is key to fully leveraging scaling laws at inference-time.

标签

会议 CVPR2026
页码 22090-22099
Bibkey
来源 CVF Open Access