视觉语言模型 · CVPR2026 ·2026.06.03

少选多推:以证据纯度优先的视频推理

Select Less, Reason More: Prioritizing Evidence Purity for Video Reasoning

Xuchen Li、Xuzhao Li、Shiyu Hu、Kaiqi Huang

与你有关的部分

提出证据感知强化学习框架,通过动态选择关键帧并在其周围局部重采样,为视频LLM提供高纯度视觉证据,可复用于需要精细时序细节的视频理解任务。

原文依据 EARL is precisely engineered to dynamically select the most relevant frames and, crucially, to perform localized re-sampling around the selected key frames to access fine-grained temporal detail.
可迁移到 视频问答视频推理时序定位

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

长视频推理仍然是视频大语言模型(Video LLMs)面临的主要挑战,因为静态均匀帧采样会导致信息稀释并掩盖关键证据。此外,现有的像素空间视频推理智能体旨在主动与视频交互以获取新的视觉信息,但由于缺乏严格的奖励机制来强制证据纯度,且无法在预采样帧之外进行时序信息补充,它们仍然表现欠佳。为弥补这一关键空白,我们基于“少选多推”的核心理念,提出了一种新颖的证据优先自适应框架。我们的核心贡献是证据感知强化学习(EARL)框架,它将模型转变为证据的主动询问者。EARL经过精心设计,能够动态选择最相关的帧,并且关键的是,在选定的关键帧周围进行局部重采样以获取细粒度的时序细节。在五个高要求的视频推理基准上的大量实验表明,我们经EARL训练的模型在开源视频大语言模型中达到了新的最优性能,同时学习到了有效且高纯度的视觉证据选择策略。令人印象深刻的是,我们的7B模型在LongVideoBench上达到59.8%,在MVBench上达到69.0%,在VideoMME上达到64.9%。这些结果凸显了优先考虑证据纯度的重要性以及我们框架的有效性。

英文原文摘要 1492 字符

Long-form video reasoning remains a major challenge for Video Large Language Models (Video LLMs), as static uniform frame sampling leads to information dilution and obscures critical evidence. Furthermore, existing pixel-space video reasoning agents, which are designed to actively interact with the video to acquire new visual information, remain suboptimal due to their lack of rigorous reward mechanisms to enforce evidence purity and their inability to perform temporal information supplementation beyond pre-sampled frames. To address this critical gap, we propose a novel evidence-prioritized adaptive framework built upon our core philosophy: "Select Less, Reason More." Our core contribution is the evidence-aware reinforcement learning (EARL) framework, which transforms the model into an active interrogator of evidence. EARL is precisely engineered to dynamically select the most relevant frames and, crucially, to perform localized re-sampling around the selected key frames to access fine-grained temporal detail. Extensive experiments on five demanding video reasoning benchmarks demonstrate that our EARL-trained model achieves new state-of-the-art among open-source Video LLMs, simultaneously learning an effective and high-purity visual evidence selection policy. Impressively, our 7B model achieves 59.8% on LongVideoBench, 69.0% on MVBench and 64.9% on VideoMME. These results highlight the importance of prioritizing evidence purity and the effectiveness of our framework.

标签

会议 CVPR2026
页码 25621-25632
Bibkey
来源 CVF Open Access