底层视觉与图像复原 · CVPR2026 ·2026.06.03

语言引导的单步扩散模型用于夜间眩光去除

Language-Guided One-Step Diffusion Model for Nighttime Flare Removal

Aoxiang Ning、Kailong Yu、Minglong Xue、Liyuan Pan、Jinhong He、Wenchao Yan 等 8 人

与你有关的部分

把视觉语言模型提取的细粒度文本语义作为条件注入单步扩散,并用语义感知分布蒸馏稳定一步采样,可迁移到其他强退化复原任务(如夜间去雨、去雾、镜头污渍去除)中,用语义先验约束被遮挡区域的生成。

原文依据 we propose a language-guided one-step diffusion framework that explicitly aligns flare-occluded regions with the underlying scene content at the semantic level
可迁移到 夜间眩光去除图像复原单步扩散采样文本引导图像生成

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

夜间摄影易受强光源产生的眩光影响,眩光会降低视觉质量并破坏下游视觉任务所需的结构信息。现有夜间眩光去除方法普遍缺乏对被眩光遮挡区域的语义先验,因而在严重退化条件下容易引入伪影并丢失细节。为解决该问题,本文提出一种语言引导的单步扩散框架,在语义层面显式地将被眩光遮挡区域与底层场景内容对齐。具体而言,我们构建了首个面向眩光的视觉语言模型 Flare-VLM,它提取细粒度文本描述以引导单步扩散,从而对严重受损区域实现高质量复原。随后,我们提出语义感知分布蒸馏,用高层语义约束噪声分布,抑制干净背景上的冗余扰动并提升蒸馏的稳定性。此外,我们设计了一条指令驱动的数据合成流程,用于生成在几何与语义上对齐的夜间眩光样本,缩小与真实退化之间的差距。实验结果表明,所提方法取得了更好的复原效果,并提升了下游视觉任务的性能。

英文原文摘要 1314 字符

Nighttime photography is susceptible to flare caused by strong light sources, which degrades visual quality and disrupts structural information required by downstream vision tasks. Existing nighttime flare removal methods generally lack semantic priors for flare-occluded regions and thus tend to introduce artifacts and lose details under severe degradation. To address this problem, we propose a language-guided one-step diffusion framework that explicitly aligns flare-occluded regions with the underlying scene content at the semantic level. Specifically, we develop the first flare-specific vision-language model, Flare-VLM, which extracts fine-grained textual descriptions to guide one-step diffusion for high-quality restoration of severely damaged areas. Then, we propose semantics-aware distribution distillation to constrain the noise distribution with high-level semantics, suppressing redundant perturbations on clean backgrounds and improving the stability of distillation. In addition, we design an instruction-driven data synthesis pipeline to generate geometrically and semantically aligned nighttime flare samples, narrowing the gap to real degradations. Experimental results demonstrate that the proposed method achieves better restoration and enhances the performance of downstream vision tasks.

标签

会议 CVPR2026
页码 38442-38452
Bibkey
来源 CVF Open Access