视觉语言模型 · CVPR2026 ·2026.06.03

MedGRPO:面向异构医学视频理解的多任务强化学习

MedGRPO: Multi-Task Reinforcement Learning for Heterogeneous Medical Video Understanding

Yuhao Su、Anwesa Choudhuri、Zhongpai Gao、Benjamin Planche、Van Nguyen Nguyen、Meng Zheng 等 11 人

与你有关的部分

针对医学视频理解中多数据集奖励尺度不平衡导致RL训练崩溃的问题,提出跨数据集奖励归一化方法,将各数据集的中位性能映射到统一奖励值,使多任务强化学习稳定;同时引入医学LLM评判器从五个临床维度评估描述质量,为视觉-语言模型在专业领域的多任务RL微调提供可复用方案。

原文依据 cross-dataset reward normalization that maps each dataset's median performance to a common reward value
可迁移到 医学视频理解视频描述生成视觉定位

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

大型视觉-语言模型在医学视频理解方面表现不佳,而空间精度、时序推理和临床语义在此类任务中至关重要。为此,我们首先构建了 MedVidBench,这是一个大规模基准,包含来自 8 个医学来源的 531,850 个视频-指令对,覆盖视频、片段和帧级任务,并通过严格的质量保证流程(包括专家引导的提示和双模型验证)进行整理。在 MedVidBench 上进行监督微调虽能带来显著提升,但标准强化学习(RL)因数据集间奖励尺度不平衡而失败,这种不平衡会破坏优化稳定性并导致训练崩溃。为解决此问题,我们提出了 MedGRPO,一种用于平衡多数据集训练的新型 RL 框架,其两项关键创新为:(1) 跨数据集奖励归一化,将每个数据集的中位性能映射到统一的奖励值,确保无论难度如何都能进行公平优化;(2) 医学 LLM 评判器,通过比较相似性评分从五个临床维度评估描述质量。在 MedVidBench 上对 Qwen2.5-VL-7B 进行监督微调后,其在所有任务上均大幅超越 GPT-4.1 和 Gemini-2.5-Flash,证明了 MedVidBench 的有效性;而我们的 MedGRPO 框架在视觉定位和描述任务上进一步提升了监督微调基线的性能。我们的工作为推进医学领域的视觉-语言模型建立了一个基础性基准和稳健的训练方法。

英文原文摘要 1485 字符

Large vision-language models struggle with medical video understanding, where spatial precision, temporal reasoning, and clinical semantics are critical. To address this, we first introduce MedVidBench, a large-scale benchmark of 531,850 video-instruction pairs across 8 medical sources spanning video, segment, and frame-level tasks, curated through a rigorous quality assurance pipeline with expert-guided prompting and dual-model validation. While supervised fine-tuning on MedVidBench yields noticeable gains, standard Reinforcement Learning (RL) fails due to imbalanced reward scales across datasets, which destabilizes optimization and leads to training collapse. To overcome this, we introduce MedGRPO, a novel RL framework for balanced multi-dataset training with two key innovations: (1) cross-dataset reward normalization that maps each dataset's median performance to a common reward value, ensuring fair optimization regardless of difficulty, and (2) a medical LLM judge that evaluates caption quality on five clinical dimensions through comparative similarity scoring. Supervised fine-tuning Qwen2.5-VL-7B on MedVidBench substantially outperforms GPT-4.1 and Gemini-2.5-Flash across all tasks, demonstrating MedVidBench's efficacy, while our MedGRPO framework further improves upon the SFT baseline across grounding and captioning tasks. Our work establishes a foundational benchmark and robust training methodology for advancing vision-language models in medical domains.

标签

会议 CVPR2026
页码 2788-2798
Bibkey
来源 CVF Open Access