数据集与评测 · CVPR2026 ·2026.06.03

ClimaOoD:通过物理真实的合成数据改进异常分割

ClimaOoD: Improving Anomaly Segmentation via Physically Realistic Synthetic Data

Yuxing Liu、Zheng Li、Huanhuan Liang、Ji Zhang、Zeyu Sun、Yong Liu

与你有关的部分

ClimaDrive 的语义引导图像到图像框架可生成物理真实、天气多样的 OoD 驾驶数据,为异常分割模型提供高质量训练数据;其结构引导多天气生成与提示驱动异常修复的统一思路,可复用于其他需要合成异常样本的视觉任务。

原文依据 we present ClimaDrive, a semantics-guided image-to-image framework for synthesizing semantically coherent, weather-diverse, and physically plausible OoD driving data
可迁移到 异常分割开放世界目标检测语义分割合成数据生成

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

异常分割旨在检测并定位超出预定义语义类别的未知或分布外(OoD)对象——这是安全自动驾驶的一项关键能力。然而,异常数据的稀缺性和有限多样性严重制约了模型在开放世界环境中的泛化能力。现有方法通过合成数据生成来缓解这一问题,要么将外部对象复制粘贴到驾驶场景中,要么利用文本到图像扩散模型对异常区域进行修复。尽管这些方法提升了异常多样性,但它们往往缺乏上下文连贯性和物理真实性,导致合成数据与真实数据之间存在域差距。本文提出 ClimaDrive,一个语义引导的图像到图像框架,用于合成语义连贯、天气多样且物理合理的 OoD 驾驶数据。ClimaDrive 将结构引导的多天气生成与提示驱动的异常修复相统一,能够创建视觉上真实的训练数据。基于该框架,我们构建了 ClimaOoD,一个大规模基准,涵盖晴朗和恶劣天气条件下的六种代表性驾驶场景。在四种最优方法上的大量实验表明,使用 ClimaOoD 训练可带来异常分割的稳健提升。在所有方法上,AUROC、AP 和 FPR95 均显示出显著增益,其中 RbA 在 Fishyscapes LAF 上的 FPR95 从 3.97 降至 3.52。这些结果表明,ClimaOoD 增强了模型鲁棒性,为开放世界异常检测中更好的泛化提供了有价值的训练数据。

英文原文摘要 1632 字符

Anomaly segmentation seeks to detect and localize unknown or out-of-distribution (OoD) objects that fall outside predefined semantic classes--a capability essential for safe autonomous driving. However, the scarcity and limited diversity of anomaly data severely constrain model generalization in open-world environments. Existing approaches mitigate this issue through synthetic data generation, either by copy-pasting external objects into driving scenes or by leveraging text-to-image diffusion models to inpaint anomalous regions. While these methods improve anomaly diversity, they often lack contextual coherence and physical realism, resulting in domain gaps between synthetic and real data. In this paper, we present ClimaDrive, a semantics-guided image-to-image framework for synthesizing semantically coherent, weather-diverse, and physically plausible OoD driving data. ClimaDrive unifies structure-guided multi-weather generation with prompt-driven anomaly inpainting, enabling the creation of visually realistic training data. Based on this framework, we construct ClimaOoD, a large-scale benchmark spanning six representative driving scenarios under both clear and adverse weather conditions.Extensive experiments on four state-of-the-art methods show that training with ClimaOoD leads to robust improvements in anomaly segmentation. Across all methods, AUROC, AP, and FPR95 show notable gains, with FPR95 dropping from 3.97 to 3.52 for RbA on Fishyscapes LAF. These results demonstrate that ClimaOoD enhances model robustness, offering valuable training data for better generalization in open-world anomaly detection.

标签

会议 CVPR2026
页码 17853-17862
Bibkey
来源 CVF Open Access