鲁棒性与安全 · CVPR2026 ·2026.06.03

面向鲁棒目标检测的分布对齐多模态融合

Distribution-Aligned Multimodal Fusion for Robust Object Detection

Xiaohui Hao、Yanglin Pu、Yongjun Wang、Rui She

与你有关的部分

冻结预训练检测器、只训练轻量融合模块,并把融合特征对齐到检测器最优工作的预训练分布,这一思路可直接迁移到任何多模态或跨域检测的适配场景,避免针对训练退化过拟合。

原文依据 aligning fused features to the pretrained distribution where the frozen detector performs optimally
可迁移到 RGB-infrared object detectionmultimodal fusiondomain generalization

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

跨退化泛化仍是 RGB-红外多模态目标检测的关键挑战,尤其当训练数据仅覆盖有限的退化类型时。本文提出一种分布对齐框架,其核心洞见是:将融合特征对齐到预训练分布——即冻结检测器表现最优的分布——而非去适应训练中特定的退化。通过冻结预训练检测器并仅训练一个轻量融合模块,本方法利用互补的红外信息来减小分布偏移,同时保持计算效率。该方法在三个基准上取得最优结果,训练速度提升 4 倍。关键的是,我们证明在泛化到未见场景时,对齐预训练分布显著优于对齐训练退化。

英文原文摘要 878 字符

Cross-degradation generalization remains a critical challenge for RGB-infrared multimodal object detection, especially when training data covers limited degradation types. This paper presents a distribution alignment framework with a key insight: aligning fused features to the pretrained distribution where the frozen detector performs optimally, rather than adapting to training-specific degradations. By freezing the pretrained detector and training only a lightweight fusion module, our approach leverages complementary infrared information to reduce distribution shift while maintaining computational efficiency. The method achieves state-of-the-art results on three benchmarks with 4x faster training. Critically, we demonstrate that aligning to the pretrained distribution substantially outperforms aligning to training degradations when generalizing to unseen scenarios.

标签

会议 CVPR2026
页码 25494-25503
Bibkey
来源 CVF Open Access