基于奖励引导自强化策略的无配对图像去雨
Unpaired Image Deraining Using Reward-Guided Self-Reinforcement Strategy
提出基于IQA的动态奖励回收与自强化训练策略,可复用于其他无监督底层视觉任务(如去噪、去雾),通过挖掘训练过程中的高质量输出构建伪配对数据来约束优化空间。
原文依据 we introduce RGSUD (Reward-Guided Self-Reinforcement Unsupervised Image Deraining), comprising two key stages: reward recycling and self-reinforcement (SR) training.
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论无监督去雨因其无需配对监督即可学习真实世界雨分布的能力而受到关注。然而,缺乏强约束使得网络难以收敛,尤其是在雨退化复杂多样的情况下。一个关键动机是,训练过程中偶尔会出现高质量的去雨结果,这些结果可用于指导优化过程。为克服这些挑战,我们提出了RGSUD(奖励引导自强化无监督图像去雨),包含两个关键阶段:奖励回收和自强化(SR)训练。在奖励回收阶段,我们提出了一种基于图像质量评估(IQA)的动态奖励回收机制,在训练过程中选择最优的去雨输出并持续收集高质量去雨图像。在SR训练阶段,我们将这些奖励纳入模型优化过程,约束优化空间并改善去雨输出与干净图像之间的对齐。通过利用基于IQA的自强化损失和动态更新的奖励,我们提升了合成伪配对数据的质量并稳定了优化。大量实验表明,我们的方法在多个数据集上取得了SOTA性能,包括配对合成、配对真实和无配对真实图像,在主观和客观IQA指标上均优于现有的无监督去雨方法。此外,我们展示了自强化策略可适用于其他无监督去雨方法。
英文原文摘要 1606 字符
Unsupervised deraining has attracted attention for its ability to learn the real-world distribution of rain without paired supervision. However, the lack of strong constraints makes it difficult for the network to converge, especially with the complex diversity of rain degradation. A key motivation is that high-quality deraining results occasionally emerge during training, which can be leveraged to guide the optimization process. To overcome these challenges, we introduce RGSUD (Reward-Guided Self-Reinforcement Unsupervised Image Deraining), comprising two key stages: reward recycling and self-reinforcement (SR) training. In the reward recycling stage, we propose an Image Quality Assessment (IQA)-based dynamic reward recycling mechanism that selects optimal derained outputs during training and continuously collects high-quality deraining images. In the SR training stage, we incorporate these rewards into the model's optimization process, constraining the optimization space and improving alignment between derained outputs and clean images. By leveraging IQA-based self reinforced loss and dynamically updated rewards, we enhance the quality of synthesized pseudo-paired data and stabilize the optimization. Extensive experiments demonstrate that our method achieves SOTA performance across multiple datasets, including paired synthetic, paired real, and unpaired real images, outperforming existing unsupervised deraining approaches in both subjective and objective IQA metrics. Additionally, we show that the Self Reinforcement Strategy is adaptable to other unsupervised deraining methods.