数据集与评测 · CVPR2026 ·2026.06.03

SpatialVID:带空间标注的大规模视频数据集

SpatialVID: A Large-Scale Video Dataset with Spatial Annotations

Jiahao Wang、Yufeng Yuan、Rujie Zheng、Youtian Lin、Jian Gao、Lin-Zhuo Chen 等 14 人

与你有关的部分

SpatialVID 提供了带逐帧相机位姿、深度图、动态掩码和运动指令的大规模真实视频,可直接用于训练可控视频生成、几何重建和世界模型,解决这些任务缺乏真实动态场景真值相机运动数据的问题。

原文依据 we collect **SpatialVID**, a dataset consisting of a large corpus of in-the-wild videos with diverse scenes, camera movements and dense 3D annotations such as per-frame camera poses, depth, and motion instructions.
可迁移到 可控视频生成几何重建世界模拟深度估计

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

空间智能领域已取得显著进展,涵盖空间重建与世界探索。然而,当前模型的可扩展性与真实世界保真度仍受限于大规模高质量训练数据的稀缺。尽管已有若干数据集提供相机位姿信息,但它们通常在规模、多样性和标注丰富度上存在局限,尤其是对于具有真值相机运动的真实动态场景。为此,我们收集了 SpatialVID,一个包含大量野外视频的数据集,具有多样化的场景、相机运动和密集的 3D 标注,如逐帧相机位姿、深度和运动指令。具体而言,我们收集了超过 21,000 小时的原始视频,并通过分层过滤流程将其处理为 270 万个片段,总计 7,089 小时的动态内容。随后的标注流程为这些片段丰富了详细的空间和语义信息,包括相机位姿、深度图、动态掩码、结构化描述和序列化运动指令。对 SpatialVID 数据统计的分析揭示了其丰富性和多样性,这直接促进了模型泛化能力和性能的提升,使其成为视频和 3D 视觉研究社区的关键资产。通过广泛的验证实验,我们展示了 SpatialVID 在可控视频生成、世界模拟和几何重建等任务上的有效性,为空间智能研究提供了坚实的基础。

英文原文摘要 1568 字符

Significant progress has been made in spatial intelligence, spanning both spatial reconstruction and world exploration. However, the scalability and real-world fidelity of current models remain severely constrained by the scarcity of large-scale, high-quality training data. While several datasets provide camera pose information, they are typically limited in scale, diversity, and annotation richness, particularly for real-world dynamic scenes with ground-truth camera motion.To this end, we collect **SpatialVID**, a dataset consisting of a large corpus of in-the-wild videos with diverse scenes, camera movements and dense 3D annotations such as per-frame camera poses, depth, and motion instructions.Specifically, we collect more than 21,000 hours of raw video, and process them into 2.7 million clips through a hierarchical filtering pipeline, totaling 7,089 hours of dynamic content. A subsequent annotation pipeline enriches these clips with detailed spatial and semantic information, including camera poses, depth maps, dynamic masks, structured captions, and serialized motion instructions.Analysis of SpatialVID's data statistics reveals a richness and diversity that directly foster improved model generalization and performance, establishing it as a key asset for the video and 3D vision research community.Through extensive validation experiments, we demonstrate SpatialVID's effectiveness across tasks such as controllable video generation, world simulation and geometric reconstruction, providing a strong foundation for spatial intelligence research.

标签

会议 CVPR2026
页码 42592-42603
Bibkey
来源 CVF Open Access