自动驾驶与遥感 · CVPR2026 ·2026.06.03

DriverGaze360:面向目标级引导的全向驾驶员注意力

DriverGaze360: OmniDirectional Driver Attention with Object-Level Guidance

Shreedhar Govil、Didier Stricker、Jason Rambach

与你有关的部分

把驾驶员注意力预测从窄前视扩展到360°全景输入,并用辅助语义分割头把注意力图与所注视目标绑定;做车载感知或多任务注意力建模的可以借鉴这种「注意力图+目标级监督」的联合学习范式,以及其全景数据采集与标注流程。

原文依据 jointly learns attention maps and attended objects by employing an auxiliary semantic segmentation head
可迁移到 驾驶员注意力预测语义分割视线估计全景图像理解

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

预测驾驶员注意力是构建可解释自动驾驶系统、理解人机混驾交通场景中驾驶员行为的关键问题。尽管大规模驾驶员注意力数据集与深度学习架构已带来显著进展,现有工作仍受限于狭窄的前向视野与有限的驾驶多样性。因此,它们无法捕捉驾驶环境的完整空间上下文,在变道、转弯以及涉及行人或骑行者等周边目标的交互过程中尤为明显。本文提出 DriverGaze360,一个大规模360度视野驾驶员注意力数据集,包含来自19名人类驾驶员的100万帧视线标注数据,可对驾驶员注视行为进行全面的全向建模。此外,我们提出全景注意力预测方法 DriverGaze360-Net,通过引入辅助语义分割头联合学习注意力图与被注视目标,从而提升宽全景输入下的空间感知与注意力预测能力。大量实验表明,DriverGaze360-Net 在全景驾驶图像上的多项指标均达到最优的注意力预测性能。数据集与方法见 https://dfki-av.github.io/drivergaze360/。

英文原文摘要 1363 字符

Predicting driver attention is a critical problem for developing explainable autonomous driving systems and understanding driver behavior in mixed human-autonomous vehicle traffic scenarios. Although significant progress has been made through large-scale driver attention datasets and deep learning architectures, existing works are constrained by narrow frontal field-of-view and limited driving diversity. Consequently, they fail to capture the full spatial context of driving environments, especially during lane changes, turns, and interactions involving peripheral objects such as pedestrians or cyclists. In this paper, we introduce DriverGaze360, a large-scale 360 field of view driver attention dataset, containing 1 million gaze-labeled frames collected from 19 human drivers, enabling comprehensive omnidirectional modeling of driver gaze behavior. Moreover, our panoramic attention prediction approach, DriverGaze360-Net, jointly learns attention maps and attended objects by employing an auxiliary semantic segmentation head. This improves spatial awareness and attention prediction across wide panoramic inputs. Extensive experiments demonstrate that DriverGaze360-Net achieves state-of-the-art attention prediction performance on multiple metrics on panoramic driving images. Dataset and method available at https://dfki-av.github.io/drivergaze360/.

标签

会议 CVPR2026
页码 39786-39795
Bibkey
来源 CVF Open Access