视频理解与时序 · CVPR2026 ·2026.06.03

以上下文提示与噪声学习增强自监督跟踪

Boosting Self-Supervised Tracking with Contextual Prompts and Noise Learning

Yaozong Zheng、Qihua Liang、Bineng Zhong、Shuimu Zeng、Yuanliang Xue、Ning Li 等 7 人

与你有关的部分

提出一种仅在训练阶段生效的双模态上下文关联机制:先用实例图像块提示引导前向/后向跟踪分支学习,再逐步注入上下文噪声扰动特征以增强鲁棒性,推理时无额外开销,可直接迁移到其他自监督视频跟踪框架。

原文依据 contextual noise is gradually injected into the model to perturb feature, encouraging the tracker to learn robust tracking representations
可迁移到 自监督视觉跟踪视频目标跟踪表征学习

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

从无标注视频中学习鲁棒的上下文知识对于推进自监督跟踪至关重要。然而,传统自监督跟踪器缺乏有效的上下文建模,而现有基于非语义查询的上下文关联方法难以适应无标注跟踪场景,导致难以学习可靠的上下文线索。本文提出一种新的自监督跟踪框架,名为 \tracker,该框架引入双模态上下文关联机制,联合利用细粒度语义提示与上下文噪声,驱动模型学习鲁棒的跟踪表征。遵循由易到难的学习原则,我们的上下文关联机制分两个阶段运行。在训练早期,将实例图像块词元(提示)同时分配给前向与后向跟踪分支,以促进跟踪知识的学习。随着训练推进,上下文噪声被逐步注入模型以扰动特征,促使跟踪器在更复杂的特征空间中学习鲁棒的跟踪表征。因此,这一新的上下文关联机制使我们的自监督模型能够从无标注视频中学习高质量的跟踪表征,同时该机制仅在训练阶段使用,以保持高效的推理。大量实验证明了本方法的优越性。

英文原文摘要 1437 字符

Learning robust contextual knowledge from unlabeled videos is essential for advancing self-supervised tracking. However, conventional self-supervised trackers lack effective context modeling, while existing context association methods based on non-semantic queries struggle to adapt to unlabeled tracking scenarios, making it difficult to learn reliable contextual cues. In this work, we propose a novel self-supervised tracking framework, named \tracker, which introduces a dual-modal context association mechanism that jointly leverages fine-grained semantic prompts and contextual noise to drive the model toward learning robust tracking representations. Adherent to the easy-to-hard learning principle, our contextual association mechanism operates based on two stages. During early training, instance patch tokens (prompts) are assigned to both forward and backward tracking branches to facilitate the acquisition of tracking knowledge. As training progresses, contextual noise is gradually injected into the model to perturb feature, encouraging the tracker to learn robust tracking representations in a more complex feature space. Thus, this novel contextual association mechanism enables our self-supervised model to learn high-quality tracking representations from unlabeled videos, while being applied exclusively during training to preserve efficient inference. Extensive experiments demonstrate the superiority of our method.

标签

会议 CVPR2026
页码 35197-35206
Bibkey
来源 CVF Open Access