生成模型与扩散 · CVPR2026 ·2026.06.03

基于得分生成模型的高效加权采样

Efficient Weighted Sampling via Score-based Generative Models

Heasung Kim、Taekyun Lee、Hyeji Kim、Gustavo De Veciana

与你有关的部分

对做扩散生成的研究者,这篇给出了一个免训练、无需 Hessian 与粒子重采样的加权采样方案:用轻量近似替代引导项的高阶导数,并按时序误差动态调节引导强度,可直接套用到 SDXL 等预训练模型上做任务自适应采样,同时获得 1.2–4.7 倍加速。

原文依据 a lightweight approximation of the guidance that avoids costly higher-order derivatives of both the score and weight functions
可迁移到 文本到图像生成扩散模型采样加速数据增强条件生成

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

加权采样——即从与「基础概率密度函数与权重函数之积」成正比的概率密度函数(PDF)中采样——是一项基础技术,在方差缩减、有偏采样、数据增强等众多领域有广泛应用。借助日益普及的预训练得分生成模型(SGM),我们提出一个免训练的加权采样框架:以有原则且计算高效的方式,用辅助引导项增强预训练的基础得分函数,从而近似目标分布的反向扩散过程。我们的方法建立在两个关键组件之上:一是对引导项的轻量近似,避免了对得分函数与权重函数的高昂高阶导数计算;二是不确定性感知调度器,它基于对近似误差的时序分析动态调整引导强度。二者结合,使得无需依赖现有方法通常所需的粒子重采样或 Hessian 计算,也能实现准确而稳定的采样。我们从合成场景到 Stable Diffusion XL 等大规模设定验证了方法的有效性,框架在任务性能上持续匹配或超越最优基线,同时取得 1.2 倍至 4.7 倍的加速。这些结果使本方法成为生成应用中面向任务自适应、时间敏感的采样的一种可扩展且推理高效的方案。

英文原文摘要 1501 字符

Weighted sampling--sampling from a probability density function (PDF) proportional to the product of a base PDF and a weight function--is a fundamental technique with wide-ranging applications in variance reduction, biased sampling, data augmentation, and more. Leveraging the increasing availability of pretrained score-based generative models (SGMs), we propose a training-free weighted sampling framework that approximates the backward diffusion process of the target distribution by augmenting the pretrained base score function with an auxiliary guidance term, in a principled and computationally efficient manner. Our approach builds on two key components: a lightweight approximation of the guidance that avoids costly higher-order derivatives of both the score and weight functions, and an uncertainty-aware scheduler that dynamically adjusts the guidance strength based on a temporal analysis of approximation error. Together, these components enable accurate and stable sampling without relying on particle-based resampling or Hessian evaluations commonly required by existing methods. We validate the effectiveness of our method from synthetic to large-scale settings such as Stable Diffusion XL, where our framework achieves 1.2xto 4.7xspeedups while consistently matching or outperforming state-of-the-art baselines in task performance. These results position our method as a scalable and inference-efficient solution for task-adaptive, time-sensitive sampling in generative applications.

标签

会议 CVPR2026
页码 1155-1166
Bibkey
来源 CVF Open Access