视觉语言模型 · CVPR2026 ·2026.06.03

OpenMMReasoner:以开放通用方案推动多模态推理前沿

OpenMMReasoner: Pushing the Frontiers in Multimodal Reasoning with an Open and General Recipe

Kaichen Zhang、Keming Wu、Zuhao Yang、Bo Li、Kairui Hu、Bin Wang 等 8 人

与你有关的部分

提供了一套透明可复现的多模态推理训练流程(SFT+RL),视觉研究者可直接复用其数据构建与训练设计来提升VLM的推理能力,或作为基线进行对比。

原文依据 a fully transparent two-stage recipe for multimodal reasoning spanning supervised fine-tuning (SFT) and reinforcement learning (RL)
可迁移到 视觉问答多模态推理视觉语言理解

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

近期推理语言模型的进展激发了将其能力扩展到多模态领域的兴趣。然而,尽管在视觉和视频推理方面取得了显著进步,缺乏透明且可复现的数据整理与训练流程仍然是可扩展研究的主要障碍。在本工作中,我们提出了OpenMMReasoner,一个完全透明的两阶段多模态推理方案,涵盖监督微调(SFT)和强化学习(RL)。在SFT阶段,我们构建了一个包含87.4万样本的冷启动数据集,并进行了严格的逐步验证,为推理能力提供了坚实基础。随后的RL阶段利用了一个涵盖多样领域的7.4万样本数据集,进一步锐化并稳定这些能力,从而形成更稳健和高效的学习过程。大量评估表明,我们的训练方案不仅超越了强基线,还突显了数据质量和训练设计在塑造多模态推理性能中的关键作用。值得注意的是,我们的方法在九个多模态推理基准上相比Qwen2.5-VL-7B-Instruct基线取得了9.5%的提升,为未来大规模多模态推理研究奠定了坚实的实证基础。

英文原文摘要 1289 字符

Recent advancements in reasoning language models have fueled growing interest in extending such capabilities to multimodal domains. However, despite notable progress in visual and video reasoning, the lack of transparent and reproducible data curation and training pipelines remains a major barrier to scalable research. In this work, we introduce OpenMMReasoner, a fully transparent two-stage recipe for multimodal reasoning spanning supervised fine-tuning (SFT) and reinforcement learning (RL). In the SFT stage, we construct an 874k-sample cold-start dataset with rigorous step-by-step validation, providing a strong foundation for reasoning capabilities. The subsequent RL stage leverages a 74k-sample dataset across diverse domains to further sharpen and stabilize these abilities, resulting in a more robust and efficient learning process. Extensive evaluations demonstrate that our training recipe not only surpasses strong baselines but also highlights the critical role of data quality and training design in shaping multimodal reasoning performance. Notably, our method achieves a 9.5% improvement over the Qwen2.5-VL-7B-Instruct baseline across nine multimodal reasoning benchmarks, establishing a solid empirical foundation for future large-scale multimodal reasoning research.

标签

会议 CVPR2026
页码 19276-19286
Bibkey
来源 CVF Open Access