生成模型与扩散 · CVPR2026 ·2026.06.03

SpatialReward:面向文本到图像生成中细粒度空间一致性的可验证空间奖励建模

SpatialReward: Verifiable Spatial Reward Modeling for Fine-Grained Spatial Consistency in Text-to-Image Generation

Sashuai Zhou、Qiang Zhou、Junpeng Ma、Yue Cao、Ruofan Hu、Ziang Zhang 等 12 人

与你有关的部分

提供了一套可验证的空间奖励建模流程:用提示词分解器抽取实体与空间元数据,用专家检测器做视觉定位,再用视觉语言模型做思维链推理判断空间关系,可直接作为强化学习微调 T2I 模型(SD、FLUX)的奖励信号,也可复用其 SpatRelBench 评测生成图像的空间一致性。

原文依据 a vision-language model applies chain-of-thought reasoning over grounded observations to assess complex spatial relations
可迁移到 文本到图像生成空间关系理解强化学习微调生成图像评测

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

近期,通过强化学习(RL)进行的文本到图像(T2I)生成取得了进展,这得益于能够评估语义对齐与视觉质量的奖励模型。然而,现有大多数奖励模型对细粒度空间关系的关注有限,常常生成整体看似合理、但物体定位不准确的图像。在本工作中,我们提出 SpatialReward,一种显式设计用于评估生成图像中空间布局的可验证奖励模型。SpatialReward 采用多阶段流程:提示词分解器从自由形式的提示词中抽取实体、属性与空间元数据;专家检测器提供物体位置与属性的准确视觉定位;视觉语言模型则对定位后的观测结果施加思维链推理,以评估规则方法难以处理的复杂空间关系。为更全面地评估生成图像中的空间关系,我们提出 SpatRelBench,一个覆盖物体属性、朝向、物体间关系以及渲染文本摆放位置的基准。在 Stable Diffusion 与 FLUX 上的实验表明,将 SpatialReward 纳入强化学习训练能够持续提升空间一致性与整体生成质量,且结果与人类判断更为吻合。这些发现表明,可验证奖励模型在实现文本到图像生成模型更准确、更可控的优化方面具有相当大的潜力。

英文原文摘要 1507 字符

Recent advances in text-to-image (T2I) generation via reinforcement learning (RL) have benefited from reward models that assess semantic alignment and visual quality. However, most existing reward models pay limited attention to fine-grained spatial relationships, often producing images that appear plausible overall yet contain inaccuracies in object positioning. In this work, we present SpatialReward, a verifiable reward model explicitly designed to evaluate spatial layouts in generated images. SpatialReward adopts a multi-stage pipeline: a Prompt Decomposer extracts entities, attributes, and spatial metadata from free-form prompts; expert detectors provide accurate visual grounding of object positions and attributes; and a vision-language model applies chain-of-thought reasoning over grounded observations to assess complex spatial relations that are challenging for rule-based methods. To more comprehensively evaluate spatial relationships in generated images, we introduce SpatRelBench, a benchmark covering object attributes, orientation, inter-object relations, and rendered text placement. Experiments on Stable Diffusion and FLUX show that incorporating SpatialReward into RL training consistently improves spatial consistency and overall generation quality, with results aligned more closely to human judgments. These findings indicate that verifiable reward models hold considerable potential for enabling more accurate and controllable optimization in text-to-image generation models.

标签

会议 CVPR2026
页码 647-658
Bibkey
来源 CVF Open Access