自动驾驶与遥感 · CVPR2026 ·2026.06.03

WhisperNet:一种可扩展的带宽高效协同感知方案

WhisperNet: A Scalable Solution for Bandwidth-Efficient Collaboration

Gong Chen、Chaokun Zhang、Xinyan Zhao

与你有关的部分

提出以接收端为中心的全局协调范式,通过轻量显著性元数据与全局请求计划动态分配带宽,并设计协同特征路由模块对齐消息,可即插即用地提升现有协同感知模型的通信效率与鲁棒性。

原文依据 WhisperNet achieves state-of-the-art performance, improving AP@0.7 on OPV2V by 2.4% with only 0.5% of the communication cost.
可迁移到 协同感知3D目标检测带宽高效通信

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

协同感知对自动驾驶至关重要,但仍受限于紧张的通信预算。先前工作通过固定速率编码器压缩完整特征图来降低带宽,但这种方法对变化环境的适应性较差;后续发展为空间选择方法,通过聚焦显著区域提升效率,但这种以对象为中心的方法往往牺牲全局上下文,削弱整体场景理解。为克服这些局限,我们提出WhisperNet,一种带宽感知框架,提出了一种新颖的、以接收端为中心的范式,用于智能体间的全局协调。发送端生成轻量级显著性元数据,接收端则制定全局请求计划,动态地为各智能体和特征分配预算,仅检索最具信息量的特征。随后,协同特征路由模块在融合前对齐相关消息,以确保结构一致性。大量实验表明,WhisperNet达到最优性能,在OPV2V上以仅0.5%的通信成本将AP@0.7提升2.4%。作为一个即插即用组件,它仅用5%的全带宽即可提升强基线,并在定位噪声下保持鲁棒性。这些结果表明,在共享什么和在哪里共享上进行全局协调分配,是实现高效协同感知的关键。

英文原文摘要 1431 字符

Collaborative perception is vital for autonomous driving yet remains constrained by tight communication budgets. Earlier work reduced bandwidth by compressing full feature maps with fixed-rate encoders, which adapts poorly to a changing environment, and it further evolved into spatial selection methods that improve efficiency by focusing on salient regions, but this object-centric approach often sacrifices global context, weakening holistic scene understanding. To overcome these limitations, we introduce WhisperNet, a bandwidth-aware framework that proposes a novel, receiver-centric paradigm for global coordination across agents. Senders generate lightweight saliency metadata, while the receiver formulates a global request plan that dynamically budgets feature contributions across agents and features, retrieving only the most informative features. A collaborative feature routing module then aligns related messages before fusion to ensure structural consistency.Extensive experiments show that WhisperNet achieves state-of-the-art performance, improving AP@0.7 on OPV2V by 2.4% with only 0.5% of the communication cost. As a plug-and-play component, it boosts strong baselines with merely 5% of full bandwidth while maintaining robustness under localization noise. These results demonstrate that globally-coordinated allocation across what and where to share is the key to achieving efficient collaborative perception.

标签

会议 CVPR2026
页码 32154-32163
Bibkey
来源 CVF Open Access