基于混合先验引导伪样本生成的零样本图像去噪
Zero-Shot Image Denoising via Hybrid Prior-Guided Pseudo Sample Generation
提出局部(梯度合并分组下采样)与全局(高斯分布条件随机采样)双先验驱动的伪样本生成范式,并配合傅里叶域分频带加权损失,可直接迁移到无外部数据训练的去噪、去模糊等复原任务中。
原文依据 we propose a novel framework of pseudo sample generation for zero-shot denoising guided by local and global image priors
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论零样本图像去噪近年来受到广泛关注,因为它本质上依赖图像的内在先验,而非从外部数据中学习。然而,现有大多数方法要么未能充分利用全局先验,要么未能妥善保留由局部先验所支配的细粒度细节。在本工作中,我们提出了一种新颖的伪样本生成框架,用于在局部与全局图像先验引导下进行零样本去噪。具体而言,我们提出了一种精心设计的下采样器,基于小窗口内的梯度合并与分组,利用空间局部性生成下采样样本。同时,设计了一种以高斯分布为条件的全局随机采样器,以纳入自然图像的非局部自相似性。这两种采样器构建了一种由局部与全局先验共同驱动的伪样本生成新范式,称为零样本混合先验引导去噪(ZS-HPD)。考虑到噪声更易影响高频细节,我们还提出了一种简单而有效的损失,该损失在傅里叶域中工作,并对不同频带施加判别性权重。在基准数据集上的大量实验证明了我们的 ZS-HPD 优于现有先进方法。我们的 ZS-HPD 代码将在此处提供。
英文原文摘要 1348 字符
Zero-shot image denoising has gained prominence in recent years, as it inherently relies on the intrinsic priors of images rather than learning from external data. Nevertheless, most existing methods either fail to fully exploit global priors, or do not properly preserve the fine-grained details governed by local priors. In this work, we propose a novel framework of pseudo sample generation for zero-shot denoising guided by local and global image priors. Specifically, we propose a well-crafted down-sampler based on gradient merging and grouping within a small window to generate down-sampled samples by exploiting spatial locality. Meanwhile, a global random sampler conditioned on a Gaussian distribution is devised to incorporate the nonlocal self-similarity of natural images. These two samplers build a new paradigm of pseudo sample generation powered by both local and global priors, which is termed as Zero-Shot Hybrid Prior-guided Denoising (ZS-HPD). Considering that noise is more likely to affect high-frequency details, we also present a simple yet effective loss that works in the Fourier domain and applies discriminative weights to distinct spectral bands. Numerous experiments on benchmark datasets have demonstrated the superiority of our ZS-HPD over existing advanced methods. The code of our ZS-HPD will be available at here.