自动驾驶与遥感 · CVPR2026 ·2026.06.03

面向内参感知的单目3D目标检测

Towards Intrinsic-Aware Monocular 3D Object Detection

Zhihao Zhang、Abhinav Kumar、Xiaoming Liu

与你有关的部分

用 LLM/VLM 把相机内参编码成语义嵌入,再通过层级式内参适配模块调制检测网络特征,为跨相机内参泛化与多数据集联合训练提供了一条可复用的条件注入思路。

原文依据 MonoIA employs large language models and vision-language models to generate intrinsic embeddings that encode the visual and geometric implications of camera parameters
可迁移到 单目3D目标检测跨域泛化多数据集联合训练

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

单目3D目标检测(Mono3D)旨在从单张RGB图像推断目标在三维空间中的位置与尺寸。尽管近期取得了进展,现有方法仍对相机内参高度敏感,难以在不同设置之间泛化,因为内参决定了三维场景如何投影到图像平面。我们提出 MonoIA,一个统一的、内参感知的框架,通过语言接地的表征来建模并适应内参变化。其核心洞见在于:内参变化并非数值差异,而是一种改变表观尺度、透视与空间几何的感知变换。为捕捉这一效应,MonoIA 采用大语言模型与视觉语言模型生成内参嵌入,以编码相机参数的视觉与几何含义。这些嵌入通过内参适配模块被层级式地集成到检测网络中,使模型能够依据相机特定配置调制其特征表示,并在不同内参下保持一致的3D检测。这将内参建模从数值条件化转变为语义表征,从而实现跨相机的鲁棒且统一的感知。大量实验表明,MonoIA 在 KITTI、Waymo 和 nuScenes 等标准基准上取得了新的最优结果(例如在 KITTI 排行榜上提升 1.18%),并在多数据集训练下进一步提升性能(例如在 KITTI Val 上提升 4.46%)。

英文原文摘要 1513 字符

Monocular 3D object detection (Mono3D) aims to infer object locations and dimensions in 3D space from a single RGB image. Despite recent progress, existing methods remain highly sensitive to camera intrinsics and struggle to generalize across diverse settings, since intrinsic governs how 3D scenes are projected onto the image plane. We propose MonoIA, a unified intrinsic-aware framework that models and adapts to intrinsic variation through a language-grounded representation.The key insight is that intrinsic variation is not a numeric difference but a perceptual transformation that alters apparent scale, perspective, and spatial geometry. To capture this effect, MonoIA employs large language models and vision-language models to generate intrinsic embeddings that encode the visual and geometric implications of camera parameters.These embeddings are hierarchically integrated into the detection network via an Intrinsic Adaptation Module, allowing the model to modulate its feature representations according to camera-specific configurations and maintain consistent 3D detection across intrinsics.This shifts intrinsic modeling from numeric conditioning to semantic representation, enabling robust and unified perception across cameras.Extensive experiments show that MonoIA achieves new state-of-the-art results on standard benchmarks including KITTI, Waymo, and nuScenes (e.g., +1.18% on the KITTI leaderboard), and further improves performance under multi-dataset training (e.g., +4.46% on KITTI Val).

标签

会议 CVPR2026
页码 40739-40750
Bibkey
来源 CVF Open Access