生成模型与扩散 · CVPR2026 ·2026.06.03

分块推进:面向自回归图像生成的测试时扩展

Progress by Pieces: Test-Time Scaling for Autoregressive Image Generation

Joonhyung Park、Hyeongwon Jang、Joowon Kim、Eunho Yang

与你有关的部分

把 LLM 的 test-time scaling 思路迁移到视觉自回归模型:用网格分区的渐进式生成 + 早期剪枝 + 锚点固定,替代 Best-of-N 的全长浪费计算,可直接用于提升任意栅格扫描式 AR 图像生成器的采样质量与成本比。

原文依据 GridAR employs a grid-partitioned progressive generation scheme in which multiple partial candidates for the same position are generated within a canvas
可迁移到 文本到图像生成自回归图像生成图像编辑

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

近期的视觉自回归(AR)模型在文本到图像生成中展现出可观的能力,其运行方式与大型语言模型类似。尽管测试时计算扩展在困难的自然语言任务上能带来更高质量的输出,但其向视觉 AR 模型的迁移仍未被探索,且面临独特挑战。朴素地套用 Best-of-N 等测试时扩展策略可能并非最优:它们会在错误的生成轨迹上消耗全长计算,而栅格扫描式解码方案缺乏对整幅画布的全局蓝图,导致只能生成少量与提示词对齐的候选,从而限制了扩展收益。为解决这些问题,我们提出 GridAR,一个旨在从视觉 AR 模型中引出尽可能优结果的测试时扩展框架。GridAR 采用网格分区的渐进式生成方案:在同一画布内为同一位置生成多个部分候选,不可行的候选被尽早剪枝,可行的候选被固定为锚点以引导后续解码。与此配合,我们提出一种布局指定的提示词重写策略,通过检视部分视图来推断满足提示词的可行布局。重写后的提示词引导后续图像生成,以缓解蓝图缺失问题。GridAR 在有限的测试时扩展下取得更高质量的结果:在 N=4 时,它在 T2I-CompBench++ 上甚至比 Best-of-N(N=8)高出 14.4%,同时降低成本 25.6%。它还可泛化到自回归图像编辑,在 PIE-Bench 上相比更大 N 的基线在语义保持上取得 14.5% 的提升。

英文原文摘要 1627 字符

Recent visual autoregressive (AR) models have shown promising capabilities in text-to-image generation, operating in a manner similar to large language models. While test-time computation scaling yields higher-quality outputs on challenging natural language tasks, its adaptation to visual AR models remains unexplored and poses unique challenges. Naively applying test-time scaling strategies such as Best-of-N can be suboptimal: they consume full-length computation on erroneous generation trajectories, while the raster-scan decoding scheme lacks a blueprint of the entire canvas, limiting scaling benefits as only a few prompt-aligned candidates are generated. To address these, we introduce GridAR, a test-time scaling framework designed to elicit the best possible results from visual AR models. GridAR employs a grid-partitioned progressive generation scheme in which multiple partial candidates for the same position are generated within a canvas, infeasible ones are pruned early, and viable ones are fixed as anchors to guide subsequent decoding. Coupled with this, we present a layout-specified prompt reformulation strategy that inspects partial views to infer a feasible layout for satisfying the prompt. The reformulated prompt guides subsequent image generation to mitigate the blueprint deficiency. GridAR achieves higher-quality results under limited test-time scaling: with N=4, it even outperforms Best-of-N (N=8) by 14.4% on T2I-CompBench++ while reducing cost by 25.6%. It also generalizes to autoregressive image editing, showing a 14.5% gain in semantic preservation on PIE-Bench over larger-N baselines.

标签

会议 CVPR2026
页码 38091-38100
Bibkey
来源 CVF Open Access