LEAD:最小化端到端驾驶中的学习者-专家不对称性
LEAD: Minimizing Learner-Expert Asymmetry in End-to-End Driving
论文把「特权专家与传感器学生之间的不对称」拆成可见性、不确定性与导航意图三个可度量的维度,并给出可操作的干预手段;做端到端驾驶或特权信息蒸馏的研究者可以直接复用这套不对称分析与 TFv6 学生策略设计,也可借鉴其把感知监督接入 sim-to-real 共享管线的做法。
原文依据 experts have significantly higher visibility (e.g., ignoring occlusions) and far lower uncertainty
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论仿真器可以生成几乎无限的驾驶数据,但仿真中的模仿学习策略仍难以实现稳健的闭环性能。受这一差距的驱动,我们实证研究了特权专家演示与基于传感器的学生观测之间的失配如何限制模仿学习的有效性。更具体地说,专家具有显著更高的可见性(例如忽略遮挡)和远更低的不确定性(例如知道其他车辆的动作),这使其难以被可靠地模仿。此外,导航意图(即要遵循的路线)在学生模型测试时仅通过单个目标点给出,因而规格不足。我们证明这些不对称性在 CARLA 中可测量地限制驾驶性能,并提出切实可行的干预措施加以解决。在经过细致修改以缩小专家与学生之间的差距后,我们的 TransFuser v6(TFv6)学生策略在所有主要公开可用的 CARLA 闭环基准上取得了新的最优性能,在 Bench2Drive 上达到 95 DS,并在 Longest6 v2 和 Town13 上将此前性能提升一倍以上。此外,通过将来自我们数据集的感知监督整合进一个共享的仿真到现实管线,我们在 NAVSIM 和 Waymo 基于视觉的端到端驾驶基准上展示了一致的增益。我们的代码、数据和模型已公开于 https://github.com/kesai-labs/lead。
英文原文摘要 1428 字符
Simulators can generate virtually unlimited driving data, yet imitation learning policies in simulation still struggle to achieve robust closed-loop performance. Motivated by this gap, we empirically study how misalignment between privileged expert demonstrations and sensor-based student observations can limit the effectiveness of imitation learning. More precisely, experts have significantly higher visibility (e.g., ignoring occlusions) and far lower uncertainty (e.g., knowing other vehicles' actions), making them difficult to imitate reliably. Furthermore, navigational intent (i.e., the route to follow) is under-specified in student models at test time via only a single target point. We demonstrate that these asymmetries can measurably limit driving performance in CARLA and offer practical interventions to address them. After careful modifications to narrow the gaps between expert and student, our TransFuser v6 (TFv6) student policy achieves a new state of the art on all major publicly available CARLA closed-loop benchmarks, reaching 95 DS on Bench2Drive and more than doubling prior performances on Longest6 v2 and Town13. Additionally, by integrating perception supervision from our dataset into a shared sim-to-real pipeline, we show consistent gains on the NAVSIM and Waymo Vision-Based End-to-End driving benchmarks. Our code, data, and models are publicly available at https://github.com/kesai-labs/lead.