图像编辑与可控生成 · CVPR2026 ·2026.06.03

TextPecker:以奖励方式量化结构异常以增强视觉文本渲染

TextPecker: Rewarding Structural Anomaly Quantification for Enhancing Visual Text Rendering

Hanshen Zhu、Yuliang Liu、Xuecheng Wu、An-Lan Wang、Hao Feng、Dingkang Yang 等 10 人

与你有关的部分

把「结构异常感知」做成可微/可打分的奖励信号,用于对任意文生图模型做 RL 微调;对做可控生成、奖励建模或 OCR 辅助生成的研究者,这套字符级异常标注数据集 + 笔画编辑合成引擎可直接复用来构造更干净的奖励。

原文依据 we propose TextPecker, a plug-and-play structural anomaly perceptive RL strategy that mitigates noisy reward signals and works with any text-to-image generator
可迁移到 text-to-image generationvisual text renderingreward modelingOCR

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

视觉文本渲染(VTR)仍是文生图生成中的关键挑战,即便是先进模型也经常生成带有畸变、模糊、错位等结构异常的文本。然而我们发现,主流多模态大模型与专用 OCR 模型在很大程度上无法感知这些结构异常,这为 VTR 评测与基于强化学习的优化都造成了关键瓶颈。因此,即便最优的生成器(如 SeedDream4.0、Qwen-Image)仍难以渲染出结构忠实的文本。为此,我们提出 TextPecker,一种即插即用的结构异常感知强化学习策略,可缓解奖励信号中的噪声,并适用于任意文生图生成器。为使该能力成为可能,我们构建了一个带有字符级结构异常标注的识别数据集,并开发了笔画编辑合成引擎以扩展结构错误的覆盖范围。实验表明,TextPecker 能稳定提升多种文生图模型;即便在已充分优化的 Qwen-Image 上,它在中文字符渲染上也显著取得结构保真度平均 4%、语义对齐平均 8.7% 的提升,确立了高保真 VTR 的新最优。我们的工作填补了 VTR 优化方面的空白,为可靠且结构忠实的视觉文本生成迈出了基础性一步。

英文原文摘要 1361 字符

Visual Text Rendering (VTR) remains a critical challenge in text-to-image generation, where even advanced models frequently produce text with structural anomalies such as distortion, blurriness, and misalignment. However, we find that leading MLLMs and specialist OCR models largely fail to perceive these structural anomalies, creating a critical bottleneck for both VTR evaluation and RL-based optimization. As a result, even state-of-the-art generators (e.g., SeedDream4.0, Qwen-Image) still struggle to render structurally faithful text. To address this, we propose TextPecker, a plug-and-play structural anomaly perceptive RL strategy that mitigates noisy reward signals and works with any text-to-image generator. To enable this capability, we construct a recognition dataset with character-level structural-anomaly annotations and develop a stroke-editing synthesis engine to expand structural-error coverage. Experiments show that TextPecker consistently improves diverse text-to-image models; even on the well-optimized Qwen-Image, it significantly yields average gains of 4% in structural fidelity and 8.7% in semantic alignment for Chinese text rendering, establishing a new state-of-the-art in high-fidelity VTR. Our work fills a gap in VTR optimization, providing a foundational step towards reliable and structural faithful visual text generation.

标签

会议 CVPR2026
页码 22059-22069
Bibkey
来源 CVF Open Access