Evo-1:保持语义对齐的轻量级视觉语言动作模型
Evo-1: Lightweight Vision-Language-Action Model with Preserved Semantic Alignment
提出一种轻量级视觉语言动作模型架构,通过跨模态扩散Transformer和两阶段训练保持视觉语言骨干的语义对齐,为视觉研究者提供将VLM高效适配到机器人控制任务的思路,并展示了在低参数量下实现实时推理的可行性。
原文依据 Evo-1 builds on a native multimodal Vision-Language model (VLM), incorporating a novel cross-modulated diffusion transformer along with an optimized integration module
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论视觉语言动作(VLA)模型已成为一种强大的框架,统一了感知、语言和控制,使机器人能够通过多模态理解执行多样化任务。然而,当前的VLA模型通常包含大量参数,并严重依赖大规模机器人数据预训练,导致训练时计算成本高,且实时推理的部署能力有限。此外,大多数训练范式往往会退化视觉语言骨干的感知表示,导致过拟合和对下游任务的泛化能力差。在本工作中,我们提出Evo-1,一个轻量级VLA模型,它降低了计算量并提高了部署效率,同时在无需机器人数据预训练的情况下保持强劲性能。Evo-1基于原生多模态视觉语言模型(VLM),结合了一种新颖的交叉调制扩散Transformer以及一个优化的集成模块,共同构成一个有效的架构。我们进一步引入了一种两阶段训练范式,逐步对齐动作与感知,从而保留VLM的表示。值得注意的是,Evo-1仅有7.7亿参数,在Meta-World和RoboTwin套件上取得了最优结果,分别超越此前最佳模型12.4%和6.9%,并在LIBERO上获得了94.8%的竞争性结果。在真实世界评估中,Evo-1以高推理频率和低内存开销达到了78%的成功率,优于所有基线方法。我们发布了代码、数据和模型权重,以促进未来对轻量级高效VLA模型的研究。
英文原文摘要 1661 字符
Vision-Language-Action (VLA) models have emerged as a powerful framework that unifies perception, language, and control, enabling robots to perform diverse tasks through multimodal understanding. However, current VLA models typically contain massive parameters and rely heavily on large-scale robot data pretraining, leading to high computational costs during training, as well as limited deployability for real-time inference.Moreover, most training paradigms often degrade the perceptual representations of the Vision-Language backbone, resulting in overfitting and poor generalization to downstream tasks.In this work, we present Evo-1, a lightweight VLA model that reduces computation and improves deployment efficiency, while maintaining strong performance without pretraining on robot data. Evo-1 builds on a native multimodal Vision-Language model (VLM), incorporating a novel cross-modulated diffusion transformer along with an optimized integration module, together forming an effective architecture.We further introduce a two-stage training paradigm that progressively aligns action with perception, preserving the representations of the VLM.Notably, with only 0.77 billion parameters, Evo-1 achieves state-of-the-art results on the Meta-World and RoboTwin suite, surpassing the previous best models by 12.4% and 6.9%, respectively, and also attains a competitive result of 94.8% on LIBERO.In real-world evaluations, Evo-1 attains a 78% success rate with high inference frequency and low memory overhead, outperforming all baseline methods.We release code, data, and model weights to facilitate future research on lightweight and efficient VLA models.