强化学习与具身智能 · CVPR2026 ·2026.06.03

FLARE:面向视觉-语言机器人操作的故障感知自主纠正与恢复框架

FLARE: A Failure-Aware Framework for Autonomous Correction and Recovery in Visual-Language Robotic Manipulation

Ganlong Zhao、Zijia Tang、Xingping Chen、Zhanghui Kuang、Ye Tian、Guanbin Li

与你有关的部分

为视觉-语言-动作模型引入基于多模态大语言模型(MLLM)的在线故障监控与重置技能库,使机器人能从执行失败中自主恢复;该“重试-重置”范式可迁移到其他具身视觉任务中提升鲁棒性。

原文依据 we propose FLARE, a novel framework that endows VLAs with robust error recovery capabilities through a "Retry" and "Reset" paradigm.
可迁移到 机器人操作视觉-语言-动作学习故障检测与恢复

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

视觉-语言-动作模型(VLA)在泛化到复杂、长时程的机器人操作任务方面已展现出显著潜力。然而,其性能仍然脆弱,因为它们通常在轨迹单调、无故障的演示数据上训练。这种对“完美”数据的依赖使它们无法从常见的执行错误中恢复,例如抓取失败、物体掉落或意外碰撞。本文提出 FLARE,一种新颖的框架,通过“重试”与“重置”范式赋予 VLA 鲁棒的误差恢复能力。首先,我们引入一种“重试”机制,通过向演示中注入扰动和桥接片段来解耦机器人位姿与环境状态,使策略能够自主处理执行偏差。其次,为应对关键的、破坏状态(分布外)的故障,我们引入“重置”流程。我们利用多模态大语言模型(MLLM)进行离线故障分析,从执行视频中自动识别分布外状态。该分析能够高效、有针对性地收集一个小型以物体为中心的“重置”技能库,这些技能经过训练可将环境恢复到任务有效状态。我们的完整框架集成了这些学习到的策略。在推理时,在线 MLLM 监控器在任务执行与“重置”技能之间进行仲裁。在具有挑战性的、接触丰富的操作任务上的实验表明,我们的方法显著提高了任务成功率和鲁棒性。

英文原文摘要 1458 字符

Vision-Language-Action Models (VLAs) have demonstrated significant promise in generalizing to complex, long-horizon robotic manipulation tasks. However, their performance remains brittle, as they are typically trained on trajectory-monotonic, failure-free demonstrations. This reliance on "perfect" data leaves them unable to recover from common execution errors, such as a missed grasp, a dropped object, or an unexpected collision. In this paper, we propose FLARE, a novel framework that endows VLAs with robust error recovery capabilities through a "Retry" and "Reset" paradigm. First, we introduce a "Retry" mechanism by injecting perturbation and bridging segments that decouple robot pose from environment state into demonstrations, enabling the policy to autonomously handle execution deviations. Second, to address critical, state-breaking (OOD) failures, we introduce a "Reset" pipeline. We leverage an MLLM for offline failure analysis to automatically identify OOD states from execution videos. This analysis enables the efficient, targeted collection of a small library of object-centric "Reset" skills, which are trained to restore the environment to a task-valid state. Our full framework integrates these learned policies. At inference, an online MLLM monitor arbitrates between task execution and "Reset" skills. Experiments on challenging, contact-rich manipulation tasks show our approach significantly improves task success and robustness.

标签

会议 CVPR2026
页码 22391-22401
Bibkey
来源 CVF Open Access