SocialNav:训练受人类启发的社会感知具身导航基础模型
SocialNav: Training Human-Inspired Foundation Model for Socially-Aware Embodied Navigation
提出基于流匹配的强化学习框架 SAFE-GRPO,将社会合规性作为奖励信号融入导航策略优化,为视觉导航中的社会规范学习提供了可复用的训练范式。
原文依据 Socially-Aware FlowExploration GRPO (SAFE-GRPO), the first flow-based reinforcement learning framework for embodied navigation
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论遵循社会规范的具身导航仍是一个开放的研究挑战。SocialNav 是一个具有分层“大脑-动作”架构的社会感知导航基础模型,能够理解高层社会规范并生成低层、符合社会规范的轨迹。为实现这种双重能力,我们构建了 SocNav 数据集,这是一个包含 700 万样本的大规模集合,包括:(1)认知激活数据集,提供思维链解释和社会可通行性预测等社会推理信号;(2)专家轨迹金字塔,聚合来自互联网视频、模拟环境和真实世界机器人的多样化导航演示。我们提出了一种多阶段训练流程,逐步注入并精炼导航智能:首先通过模仿学习将通用导航技能和社会规范理解注入模型,然后通过精心设计的社会感知流探索 GRPO(SAFE-GRPO)精炼这些技能,这是首个基于流的具身导航强化学习框架,明确奖励符合社会规范的行为。与最优方法相比,SocialNav 实现了 +38% 的成功率和 +46% 的社会合规率,在导航性能和社会合规性方面均展现出显著提升。数据和代码将公开。
英文原文摘要 1425 字符
Embodied navigation that adheres to social norms remains an open research challenge. Our SocialNav is a foundational model for socially-aware navigation with a hierarchical "brain-action" architecture, capable of understanding high-level social norms and generating low-level, socially compliant trajectories. To enable such dual capabilities, we construct the SocNav Dataset, a large-scale collection of 7 million samples, comprising (1) a Cognitive Activation Dataset providing social reasoning signals such as chain-of-thought explanations and social traversability prediction, and (2) an Expert Trajectories Pyramid aggregating diverse navigation demonstrations from internet videos, simulated environments, and real-world robots. A multi-stage training pipeline is proposed to gradually inject and refine navigation intelligence: we first inject general navigation skills and social norms understanding into the model via imitation learning, and then refine such skills through a deliberately designed Socially-Aware FlowExploration GRPO (SAFE-GRPO), the first flow-based reinforcement learning framework for embodied navigation that explicitly rewards socially compliant behaviors. SocialNav achieves +38% success rate and +46% social compliance rate compared to the state-of-the-art method, demonstrating strong gains in both navigation performance and social compliance. Data and code will be made publicly available.