强化学习与具身智能 · CVPR2026 ·2026.06.03

Evo-1:保持语义对齐的轻量级视觉语言动作模型

Evo-1: Lightweight Vision-Language-Action Model with Preserved Semantic Alignment

Tao Lin、Yilei Zhong、Yuxin Du、Jingjing Zhang、Jiting Liu、Yinxinyu Chen 等 14 人

与你有关的部分

提出一种轻量级视觉语言动作模型架构,通过跨模态扩散Transformer和两阶段训练保持视觉语言骨干的语义对齐,为视觉研究者提供将VLM高效适配到机器人控制任务的思路,并展示了在低参数量下实现实时推理的可行性。

原文依据 Evo-1 builds on a native multimodal Vision-Language model (VLM), incorporating a novel cross-modulated diffusion transformer along with an optimized integration module
可迁移到 机器人操作视觉语言动作学习多模态感知与控制

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

视觉语言动作(VLA)模型已成为一种强大的框架,统一了感知、语言和控制,使机器人能够通过多模态理解执行多样化任务。然而,当前的VLA模型通常包含大量参数,并严重依赖大规模机器人数据预训练,导致训练时计算成本高,且实时推理的部署能力有限。此外,大多数训练范式往往会退化视觉语言骨干的感知表示,导致过拟合和对下游任务的泛化能力差。在本工作中,我们提出Evo-1,一个轻量级VLA模型,它降低了计算量并提高了部署效率,同时在无需机器人数据预训练的情况下保持强劲性能。Evo-1基于原生多模态视觉语言模型(VLM),结合了一种新颖的交叉调制扩散Transformer以及一个优化的集成模块,共同构成一个有效的架构。我们进一步引入了一种两阶段训练范式,逐步对齐动作与感知,从而保留VLM的表示。值得注意的是,Evo-1仅有7.7亿参数,在Meta-World和RoboTwin套件上取得了最优结果,分别超越此前最佳模型12.4%和6.9%,并在LIBERO上获得了94.8%的竞争性结果。在真实世界评估中,Evo-1以高推理频率和低内存开销达到了78%的成功率,优于所有基线方法。我们发布了代码、数据和模型权重,以促进未来对轻量级高效VLA模型的研究。

英文原文摘要 1661 字符

Vision-Language-Action (VLA) models have emerged as a powerful framework that unifies perception, language, and control, enabling robots to perform diverse tasks through multimodal understanding. However, current VLA models typically contain massive parameters and rely heavily on large-scale robot data pretraining, leading to high computational costs during training, as well as limited deployability for real-time inference.Moreover, most training paradigms often degrade the perceptual representations of the Vision-Language backbone, resulting in overfitting and poor generalization to downstream tasks.In this work, we present Evo-1, a lightweight VLA model that reduces computation and improves deployment efficiency, while maintaining strong performance without pretraining on robot data. Evo-1 builds on a native multimodal Vision-Language model (VLM), incorporating a novel cross-modulated diffusion transformer along with an optimized integration module, together forming an effective architecture.We further introduce a two-stage training paradigm that progressively aligns action with perception, preserving the representations of the VLM.Notably, with only 0.77 billion parameters, Evo-1 achieves state-of-the-art results on the Meta-World and RoboTwin suite, surpassing the previous best models by 12.4% and 6.9%, respectively, and also attains a competitive result of 94.8% on LIBERO.In real-world evaluations, Evo-1 attains a 78% success rate with high inference frequency and low memory overhead, outperforming all baseline methods.We release code, data, and model weights to facilitate future research on lightweight and efficient VLA models.

标签

会议 CVPR2026
页码 13397-13406
Bibkey
来源 CVF Open Access