自监督与表征学习 · CVPR2026 ·2026.06.03

PriVi:面向野外灵长类行为的通用视频模型

PriVi: Towards a General-Purpose Video Model for Primate Behavior in the Wild

Felix B. Mueller、Jan F. Meier、Timo Lueddecke、Richard Vogg、Roger L. Freixanet、Valentin Hassler 等 23 人

与你有关的部分

把 V-JEPA 这类视频自监督模型在领域数据(灵长类野外视频)上做继续预训练、再用冻结分类器评估的范式,可直接迁移到其他缺乏标注的细粒度视觉领域(动物行为、生态监测、医学视频),并给出了「领域级预训练」在标签稀缺时优于全量微调的经验证据。

原文依据 We continue pretraining V-JEPA, a large-scale video model, on PriVi to learn primate-specific representations
可迁移到 视频行为识别自监督视频表征学习少标注迁移学习动物行为分析

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

非人灵长类是我们现存最近的近亲,分析其行为是认知、演化与保护研究的核心。计算机视觉本可极大助力这类研究,但现有方法往往依赖以人为中心预训练的模型,且只针对单一数据集,泛化能力受限。为突破这一局限,我们从以模型为中心转向以数据为中心,提出 PriVi——一个大规模、以灵长类为中心的视频预训练数据集。PriVi 包含 424 小时精选视频,其中 174 小时来自 11 种实验设置下的行为研究,250 小时来自多样化的网络来源素材,均通过可扩展的数据整理流水线汇集而成。我们在 PriVi 上对大规模视频模型 V-JEPA 进行继续预训练,以学习灵长类特有的表征,并使用轻量级冻结分类器进行评估。在 ChimpACT、PanAf500、BaboonLand 与 ChimpBehave 四个基准数据集上,我们的方法一致优于先前工作,包括全量微调的基线,并在标签更少时表现出良好的可扩展性。这些结果首次表明,领域级预训练——即在相似数据而非目标数据集本身上进行预训练——对视频模型同样有效。以灵长类为中心的预训练显著提升了数据效率与泛化能力,使其成为低标注应用的一条有前景的路径。数据集、代码与模型见 https://privi.eckerlab.org。

英文原文摘要 1472 字符

Non-human primates are our closest living relatives, and analyzing their behavior is central to research in cognition, evolution, and conservation. Computer vision could greatly aid this research, but existing methods often rely on human-centric pretrained models and focus on single datasets, which limits generalization. We address this limitation by shifting from a model-centric to a data-centric approach and introduce PriVi, a large-scale primate-centric video pretraining dataset. PriVi contains 424 hours of curated video, combining 174 hours from behavioral research across 11 settings with 250 hours of diverse web-sourced footage, assembled through a scalable data curation pipeline. We continue pretraining V-JEPA, a large-scale video model, on PriVi to learn primate-specific representations and evaluate it using a lightweight frozen classifier. Across four benchmark datasets - ChimpACT, PanAf500, BaboonLand, and ChimpBehave - our approach consistently outperforms prior work, including fully finetuned baselines, and scales favorably with fewer labels. These results demonstrate for the first time that domain-level pretraining, where pretraining is conducted on similar data but not the target dataset itself, works for video models. Our primate-centric pretraining substantially improves data efficiency and generalization, making it a promising approach for low-label applications. Dataset, code, and models are available at https://privi.eckerlab.org.

标签

会议 CVPR2026
页码 38804-38815
Bibkey
来源 CVF Open Access