底层视觉与图像复原 · CVPR2026 ·2026.06.03

UniSER:统一软效应去除的基础模型

UniSER: A Foundation Model for Unified Soft Effects Removal

Jingdong Zhang、Lingzhi Zhang、Qing Liu、Mang Tik Chiu、Connelly Barnes、Yizhou Wang 等 15 人

与你有关的部分

把镜头光晕、雾、阴影、反射统一建模为「半透明遮挡」并用 Diffusion Transformer 做微调复原,配合细粒度掩码与强度控制,为低层复原提供了一条「一个模型处理多类软效应」的可复用范式与 3.8M 配对数据构建思路。

原文依据 we introduce a foundational versatile model UniSER, capable of addressing diverse degradations caused by soft effects within a single framework
可迁移到 图像复原去雾阴影去除反射去除

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

数字图像常被镜头光晕、雾、阴影和反射等软效应所退化,尽管底层像素仍部分可见,这些效应却会降低图像的美观度。现有工作孤立地处理这些退化,开发出高度专门化的专家模型,这类模型缺乏可扩展性,也无法利用这些复原问题所共享的内在本质。专家模型存在局限,而近期大规模预训练的通用模型提供了强大的、文本驱动的图像编辑能力;然而近期的通用系统(如 GPT-4o、Flux Kontext、Nano Banana)需要详细的提示词,且在这些细粒度任务上往往无法实现稳健的去除,或无法保持场景的一致性。利用软效应的共同本质,即半透明遮挡,我们提出了一个基础性通用模型 UniSER,能够在单一框架内处理由软效应引起的多种退化。我们的方法核心在于构建一个包含 380 万对样本的大规模数据集以确保鲁棒性与泛化能力,其中包含新颖的、物理上合理的数据,以填补公开基准中的关键空白;同时采用一套定制的训练流程,微调一个扩散 Transformer,从这些多样化数据中学习稳健的复原先验,并集成细粒度的掩码与强度控制。这种协同方法使 UniSER 显著优于专家模型与通用模型,在真实场景中实现稳健、高保真的复原。

英文原文摘要 1522 字符

Digital images are often degraded by soft effects such as lens flare, haze, shadows, and reflections, which reduce aesthetics even though the underlying pixels remain partially visible. The prevailing works address these degradations in isolation, developing highly specialized, specialist models that lack scalability and fail to exploit the shared underlying essences of these restoration problems. While specialist models are limited, recent large-scale pretrained generalist models offer powerful, text-driven image editing capabilities. while recent general-purpose systems (e.g., GPT-4o, Flux Kontext, Nano Banana) require detailed prompts and often fail to achieve robust removal on these fine-grained tasks or preserve identity of the scene. Leveraging the common essence of soft effects, i.e., semi-transparent occlusions, we introduce a foundational versatile model UniSER, capable of addressing diverse degradations caused by soft effects within a single framework. Our methodology centers on curating a massive 3.8M-pair dataset to ensure robustness and generalization, which includes novel, physically-plausible data to fill critical gaps in public benchmarks, and a tailored training pipeline that fine-tunes a Diffusion Transformer to learn robust restoration priors from this diverse data, integrating fine-grained mask and strength controls. This synergistic approach allows UniSER to significantly outperform both specialist and generalist models, achieving robust, high-fidelity restoration in the wild.

标签

会议 CVPR2026
页码 16096-16107
Bibkey
来源 CVF Open Access