生成模型与扩散 · CVPR2026 ·2026.06.03

面向文本到图像扩散模型的早期质量评估

Toward Early Quality Assessment of Text-to-Image Diffusion Models

Huanlei Guo、Hongxin Wei、Bingyi Jing

与你有关的部分

对做 T2I 生成的人,Probe-Select 提供了一种在去噪轨迹早期(约 20% 步数)用中间激活预测最终质量分、提前终止劣质种子的插件式方案,可直接嵌入现有 diffusion/flow-matching 采样循环,把 generate-then-select 的算力开销降下来。

原文依据 certain intermediate denoiser activations, even at early timesteps, encode a stable coarse structure, object layout and spatial arrangement
可迁移到 text-to-image generationdiffusion samplingimage quality assessment

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

近期的文本到图像(T2I)扩散模型与流匹配模型能够根据自然语言提示生成高度逼真的图像。在实际场景中,T2I 系统常以「先生成、后选择」的模式运行:采样大量随机种子,仅保留少数图像供使用。然而,该流程资源开销极高,因为每个候选都需要数十到数百步去噪,而 CLIPScore、ImageReward 等评价指标都是事后的。在本工作中,我们通过引入 Probe-Select 来缓解这一低效问题,该模块是一个即插即用模块,可在生成过程内部高效评估图像质量。我们观察到,某些中间去噪器激活即使在早期时间步也编码了稳定的粗粒度结构、物体布局与空间排布,而这些与最终图像的保真度高度相关。Probe-Select 利用这一性质,直接从早期激活预测最终质量分数,从而可以提前终止没有希望的种子。在扩散与流匹配骨干网络上,我们的实验表明,仅在轨迹的 20% 处进行早期评估即可准确地对候选种子排序,并支持选择性继续生成。该策略将采样成本降低 60% 以上,同时提升所保留图像的质量,表明早期结构信号能够在不改动底层生成模型的前提下有效引导选择性生成。代码见 https://github.com/Guhuary/ProbeSelect。

英文原文摘要 1488 字符

Recent text-to-image (T2I) diffusion and flow-matching models can produce highly realistic images from natural language prompts. In practical scenarios, T2I systems are often run in a "generate--then--select" mode: many seeds are sampled and only a few images are kept for use. However, this pipeline is highly resource-intensive since each candidate requires tens to hundreds of denoising steps, and evaluation metrics such as CLIPScore and ImageReward are post-hoc. In this work, we address this inefficiency by introducing Probe-Select, a plug-in module that enables efficient evaluation of image quality within the generation process. We observe that certain intermediate denoiser activations, even at early timesteps, encode a stable coarse structure, object layout and spatial arrangement--that strongly correlates with final image fidelity. Probe-Select exploits this property by predicting final quality scores directly from early activations, allowing unpromising seeds to be terminated early. Across diffusion and flow-matching backbones, our experiments show that early evaluation at only 20% of the trajectory accurately ranks candidate seeds and enables selective continuation. This strategy reduces sampling cost by over 60% while improving the quality of the retained images, demonstrating that early structural signals can effectively guide selective generation without altering the underlying generative model. Code is available at https://github.com/Guhuary/ProbeSelect.

标签

会议 CVPR2026
页码 38410-38419
Bibkey
来源 CVF Open Access