图像分割 · CVPR2026 ·2026.06.03

强化视频目标分割在分割之前先思考

Reinforcing Video Object Segmentation to Think before it Segments

Sitong Gong、Yunzhi Zhuge、Lu Zhang、Jiazuo Yu、Pingping Zhang、Xu Jia 等 7 人

与你有关的部分

把 GRPO 强化学习与思维链初始化引入视频推理分割,用整体奖励同时约束空间对齐与时序一致性;对做指代分割或视频 grounding 的研究者,这是一套可直接迁移的「先推理再出掩码」训练范式,也提供了抑制 LVLM 幻觉的奖励设计思路。

原文依据 Veason-R1 is trained through Group Relative Policy Optimization (GRPO) augmented with Chain-of-Thought (CoT) initialization.
可迁移到 视频推理分割指代视频目标分割视频目标分割

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

视频推理分割(VRS)旨在依据蕴含人类意图与时序逻辑的隐式指令,勾勒出视频中被指代的对象。已有方法利用大型视觉语言模型(LVLM)将对象语义编码为 SEG token 以进行掩码预测。然而,该范式在推理过程中可解释性有限,且由于时空推理不充分而性能欠佳。受强化学习领域里程碑式突破的启发,我们提出 Veason-R1,一个专为 VRS 设计的 LVLM,强调分割中的结构化推理。Veason-R1 通过组相对策略优化(GRPO)训练,并以思维链(CoT)初始化加以增强。首先,我们构建高质量的 CoT 训练数据以灌输结构化推理轨迹,衔接视频级语义与帧级空间定位,得到监督微调模型 Veason-SFT。随后,GRPO 微调通过优化推理链,鼓励对推理空间进行高效探索。为此,我们引入整体奖励机制,协同增强空间对齐与时序一致性,强化关键帧定位与细粒度定位。全面的实证评估表明,Veason-R1 在多个基准上取得最优性能,显著超越先前工作(例如在 ReVOS 上提升 1.3 𝒥&ℱ,在 ReasonVOS 上提升 10.0 𝒥&ℱ),同时对幻觉表现出鲁棒性(提升 8.8 ℛ)。

英文原文摘要 1608 字符

Video reasoning segmentation (VRS) endeavors to delineate referred objects in videos guided by implicit instructions that encapsulate human intent and temporal logic. Previous approaches leverage large vision language models (LVLMs) to encode object semantics into \SEG tokens for mask prediction. However, this paradigm suffers from limited interpretability during inference and suboptimal performance due to inadequate spatiotemporal reasoning. Drawing inspiration from seminal breakthroughs in reinforcement learning, we introduce Veason-R1, a specialized LVLM for VRS that emphasizes structured reasoning in segmentation. Veason-R1 is trained through Group Relative Policy Optimization (GRPO) augmented with Chain-of-Thought (CoT) initialization. To begin with, we curate high-quality CoT training data to instill structured reasoning trajectories, bridging video-level semantics and frame-level spatial grounding, yielding the supervised fine-tuned model Veason-SFT. Subsequently, GRPO fine-tuning encourages efficient exploration of the reasoning space by optimizing reasoning chains. To this end, we incorporate a holistic reward mechanism that synergistically enhances spatial alignment and temporal consistency, bolstering keyframe localization and fine-grained grounding. Comprehensive empirical evaluations demonstrate that Veason-R1 achieves state-of-the-art performance on multiple benchmarks, surpassing prior art by significant margins (e.g., +1.3 \mathcal J &\mathcal F in ReVOS and +10.0 \mathcal J &\mathcal F in ReasonVOS), while exhibiting robustness to hallucinations (+8.8 \mathcal R ).

标签

会议 CVPR2026
页码 3835-3844
Bibkey
来源 CVF Open Access