自评估解锁任意步文本到图像生成
Self-Evaluation Unlocks Any-Step Text-to-Image Generation
提出一种从零训练的自评估机制,使单一模型在极少步数下仍能生成高质量图像,且性能随推理步数增加单调提升,为少步扩散/流匹配模型训练提供了无需预训练教师的新范式。
原文依据 Self-E learns from data similarly to a Flow Matching model, while simultaneously employing a novel self-evaluation mechanism
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论我们提出自评估模型(Self-E),一种全新的从零训练文本到图像生成方法,支持任意步推理。Self-E 像流匹配模型一样从数据中学习,同时采用一种新颖的自评估机制:它利用当前分数估计来评估自己生成的样本,有效地充当动态自教师。与传统的扩散或流模型不同,它不依赖于通常需要大量推理步数的局部监督。与基于蒸馏的方法不同,它不需要预训练的教师模型。这种即时局部学习与自驱动全局匹配的结合弥合了两种范式之间的差距,使得能够从零训练出高质量的文本到图像模型,即使在极低步数下也表现出色。在大规模文本到图像基准上的大量实验表明,Self-E 不仅在少步生成中表现出色,而且在 50 步时与最优的流匹配模型相比也具有竞争力。我们进一步发现,其性能随着推理步数的增加而单调提升,从而在单一统一模型中实现超快速少步生成和高质量长轨迹采样。据我们所知,Self-E 是首个从零训练的任意步文本到图像模型,为高效可扩展的生成提供了一个统一框架。
英文原文摘要 1415 字符
We introduce the Self-Evaluating Model (Self-E), a novel, from-scratch training approach for text-to-image generation that supports any-step inference. Self-E learns from data similarly to a Flow Matching model, while simultaneously employing a novel self-evaluation mechanism: it evaluates its own generated samples using its current score estimates, effectively serving as a dynamic self-teacher. Unlike traditional diffusion or flow models, it does not rely solely on local supervision, which typically necessitates many inference steps. Unlike distillation-based approaches, it does not require a pretrained teacher. This combination of instantaneous local learning and self-driven global matching bridges the gap between the two paradigms, enabling the training of a high-quality text-to-image model from scratch that excels even at very low step counts. Extensive experiments on large-scale text-to-image benchmarks show that Self-E not only excels in few-step generation, but is also competitive with state-of-the-art Flow Matching models at 50 steps. We further find that its performance improves monotonically as inference steps increase, enabling both ultra-fast few-step generation and high-quality long-trajectory sampling within a single unified model. To our knowledge, Self-E is the first from-scratch, any-step text-to-image model, offering a unified framework for efficient and scalable generation.