3D 视觉与重建 · CVPR2026 ·2026.06.03 分类待复核 · 置信度 0.97

VGGT-Ω

VGGT-Ω

Jianyuan Wang、Minghao Chen、Shangzhan Zhang、Nikita Karaev、Johannes Schönberger、Patrick Labatut 等 10 人

与你有关的部分

用单一密集预测头加多任务监督替代高分辨率卷积层与全局注意力,并以场景 token 做特征聚合,这套架构与自监督训练协议可直接迁移到其他前馈三维重建或位姿估计模型的规模化训练中。

原文依据 a single dense prediction head with multi-task supervision, removing expensive high-resolution convolutional layers, and introducing efficient scene tokens
可迁移到 单目/多视图三维重建相机位姿估计动态场景重建深度估计

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

我们提出 VGGT-Ω,一个用于三维重建的前馈模型,在静态与动态场景上同时提升了精度、效率与能力。此前的 VGGT 等模型已表明,前馈三维重建在许多情况下可与传统基于优化的方法相竞争。本文进一步表明,这类模型的精度与鲁棒性可随模型容量和数据规模可预测地扩展。为支持在空前规模上训练三维重建模型,我们引入了提升训练效率与可扩展性的架构改动、一条支持动态场景的高质量数据标注流水线,以及一套自监督学习协议。我们大幅简化了 VGGT 的架构:采用带多任务监督的单一密集预测头,移除昂贵的高分辨率卷积层,并引入高效的场景 token 以替代全局注意力进行特征聚合。这些改动使我们能够以比此前工作多 15 倍的监督数据训练 VGGT-Ω,并利用海量无标注视频,而训练显存仅需 VGGT 的约 30%。VGGT-Ω 在多个基准上于静态与动态场景的三维重建均取得强劲结果,例如在 Sintel 上相较此前最佳的相机估计精度提升 77%。

英文原文摘要 1331 字符

We introduce VGGT-Ω, a feed-forward model for 3D reconstruction that improves accuracy, efficiency, and capabilities for both static and dynamic scenes. Prior models such as VGGT have shown that feed-forward 3D reconstruction is, in many cases, competitive with traditional optimization-based methods. Here, we show that the accuracy and robustness of these models scale predictably with model capacity and data size. To enable training 3D reconstruction models at an unprecedented scale, we introduce architectural changes that improve training efficiency and scalability, a high-quality data annotation pipeline that supports dynamic scenes, and a self-supervised learning protocol. We significantly simplify VGGT's architecture by using a single dense prediction head with multi-task supervision, removing expensive high-resolution convolutional layers, and introducing efficient scene tokens for feature aggregation in lieu of global attention. These changes allow us to train VGGT-Ω with 15 x more supervised data than prior work and to leverage vast amounts of unlabeled videos, while requiring only ~30% of VGGT's training memory. VGGT-Ω achieves strong results for 3D reconstruction of static and dynamic scenes across multiple benchmarks, e.g., improving over the previous best camera estimation accuracy by 77% on Sintel.

标签

会议 CVPR2026
页码 21486-21499
Bibkey
来源 CVF Open Access