底层视觉与图像复原 · CVPR2026 ·2026.06.03

迈向低光照理解的泛化表征:当信号恒常性遇上语义增强

Towards Generalized Representations for Low-Light Understanding: When Signal Constancy Meets Semantic Enrichment

Yifan Li、Haofeng Huang、Wenhan Yang、Jiaying Liu

与你有关的部分

把视觉基础模型的语义先验与光照不变信号先验耦合进低光照增强:用并行解码器重建光照不变分量做正则化、用 VFM 自相关图引导对比训练对齐语义空间,再用 CLIP 损失把语义线索注入像素级增强,可作为无真实低光数据下的通用域适应范式迁移到其他退化任务。

原文依据 a parallel decoder reconstructs it as a regularization target, enforcing representation consistency and reducing feature drift
可迁移到 低光照增强夜间语义分割目标检测无监督域适应

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

低光照退化会阻碍夜间机器理解。现有方法要么过拟合标注数据(成对监督),要么过拟合特定分布(非成对监督),导致在未见退化下泛化能力较差。本文提出 UniPrior,一个统一的基于先验的低光照适应框架,它将视觉基础模型(VFM)中蕴含的通用语义先验与光照不变先验相结合,在无需任何真实低光照训练数据的情况下,捕捉多种低光照退化下既稳定又变化的语义。具体而言,光照不变先验被用作辅助输入,并由一个并行解码器将其重建为正则化目标,从而强制表征一致性并减少特征漂移。这种信号恒常性使我们能够通过由 VFM 自相关图引导的对比训练策略,构建与 VFM 对齐的语义空间,用高层线索丰富特征,从而提升对多样低光照条件的适应能力。除高层特征外,我们还通过面向机器的增强方案,对统一先验与低层信号空间进行联合考虑。我们扩展信号先验以处理过曝光,并通过基于 CLIP 的损失将 VFM 引导的语义线索注入增强过程。语义对齐与像素校正的这种耦合使样本自适应优化成为可能,从而提升性能。在多个低光照任务上的大量实验证明了本方法的优越性与实用价值。

英文原文摘要 1553 字符

Low-light degradation hampers machine understanding at night. Existing methods either overfit labeled data (paired supervision) or specific distributions (unpaired supervision), resulting in poor generalization under unseen degradations. In this paper, we propose UniPrior, a unified prior-based low-light adaptation framework that integrates the general semantic prior embedded in vision foundation models (VFMs) with illumination-invariant priors, to capture both stable and changing semantics under varied low-light degradation without any real low-light training data. In detail, the illumination-invariant prior is used as an auxiliary input, and a parallel decoder reconstructs it as a regularization target, enforcing representation consistency and reducing feature drift. Such signal constancy enables us to build a VFM-aligned semantic space via a contrastive training strategy guided by VFM self-correlation maps, enriching features with high-level cues, thereby improving adaptation to diverse low-light conditions. Beyond high-level features, we also give a joint consideration of such unified prior and low-level signal space through our machine-oriented enhancement scheme. We extend the signal prior to handle overexposure and inject VFM-guided semantic cues into the enhancement process via a CLIP-based loss. This coupling of semantic alignment and pixel correction enables sample-adaptive optimization to improve performance. Extensive experiments on multiple low-light tasks demonstrate our method's superiority and practical utility.

标签

会议 CVPR2026
页码 1386-1395
Bibkey
来源 CVF Open Access