强化学习与具身智能 · CVPR2026 ·2026.06.03

InterPrior:面向基于物理的人-物体交互的可扩展生成式控制

InterPrior: Scaling Generative Control for Physics-Based Human-Object Interactions

Sirui Xu、Samuel Schulter、Morteza Ziyadi、Xialin He、Xiaohan Fei、Yu-Xiong Wang 等 7 人

与你有关的部分

提出一种从大规模模仿预训练到强化学习微调的可扩展生成式控制框架,利用多模态观测和高级意图重建全身运动,并通过物理扰动数据增强提升泛化能力,可为人形机器人的视觉-运动控制提供可复用的训练范式。

原文依据 we introduce InterPrior, a scalable framework that learns a unified generative controller through large-scale imitation pretraining and post-training by reinforcement learning.
可迁移到 人体运动生成人-物体交互机器人控制

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

人类很少在显式全身运动的层面上规划与物体的全身交互。高级意图(如可供性)定义目标,而协调的平衡、接触和操作可以从底层的物理和运动先验中自然涌现。扩展此类先验是使人形机器人能够在不同情境下组合和泛化移动操作技能、同时保持物理一致的全身协调的关键。为此,我们提出 InterPrior,一个可扩展的框架,通过大规模模仿预训练和强化学习后训练来学习统一的生成式控制器。InterPrior 首先将全参考模仿专家蒸馏为一个多功能的、目标条件变分策略,该策略从多模态观测和高级意图中重建运动。虽然蒸馏策略能够重建训练行为,但由于大规模人-物体交互的庞大配置空间,它无法可靠地泛化。为了解决这个问题,我们应用带有物理扰动的数据增强,然后进行强化学习微调,以提高在未见目标和初始化上的能力。这些步骤共同将重建的潜变量技能整合为一个有效的流形,产生一个能够泛化到训练数据之外的运动先验,例如,它可以融入新行为,如与未见物体的交互。我们进一步展示了其在用户交互控制中的有效性及其在实际机器人部署中的潜力。

英文原文摘要 1552 字符

Humans rarely plan whole-body interactions with objects at the level of explicit whole-body movements. High-level intentions, such as affordance, define the goal, while coordinated balance, contact, and manipulation can emerge naturally from underlying physical and motor priors. Scaling such priors is key to enabling humanoids to compose and generalize loco-manipulation skills across diverse contexts while maintaining physically coherent whole-body coordination. To this end, we introduce InterPrior, a scalable framework that learns a unified generative controller through large-scale imitation pretraining and post-training by reinforcement learning. InterPrior first distills a full-reference imitation expert into a versatile, goal-conditioned variational policy that reconstructs motion from multimodal observations and high-level intent. While the distilled policy reconstructs training behaviors, it does not generalize reliably due to the vast configuration space of large-scale human-object interactions. To address this, we apply data augmentation with physical perturbations, and then perform reinforcement learning finetuning to improve competence on unseen goals and initializations. Together, these steps consolidate the reconstructed latent skills into a valid manifold, yielding a motion prior that generalizes beyond the training data, e.g., it can incorporate new behaviors such as interactions with unseen objects. We further demonstrate its effectiveness for user-interactive control and its potential for real robot deployment.

标签

会议 CVPR2026
页码 23516-23527
Bibkey
来源 CVF Open Access