3D 视觉与重建 · CVPR2026 ·2026.06.03

FlashVGGT:基于压缩描述子注意力的高效可扩展视觉几何 Transformer

FlashVGGT: Efficient and Scalable Visual Geometry Transformers with Compressed Descriptor Attention

Zipeng Wang、Dan Xu

与你有关的部分

用每帧压缩出的描述子 token 替代全量 token 做全局注意力,把 VGGT 的二次复杂度降到与描述子数量相关,并通过缓存描述子的分块递归机制支持超长序列在线推理;做多视图前馈重建、长序列三维重建的人可直接复用这一注意力压缩与分块缓存思路。

原文依据 Global attention is then computed as cross-attention between the full set of image tokens and this smaller descriptor set
可迁移到 多视图三维重建新视角合成长序列三维重建

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

从多视图图像进行三维重建是计算机视觉的核心挑战。近年来,前馈方法已成为传统逐场景优化技术的高效且鲁棒的替代方案。其中,视觉几何定位 Transformer(VGGT)等最优模型利用对所有图像 token 的完整自注意力来捕捉全局关系。然而,由于自注意力的二次复杂度以及长图像序列产生的大量 token,该方法面临可扩展性差的问题。在本工作中,我们提出 FlashVGGT,一种通过基于描述子的注意力机制解决该瓶颈的高效替代方案。FlashVGGT 不在所有 token 上施加稠密全局注意力,而是将每一帧的空间信息压缩为一组紧凑的描述子 token。随后,全局注意力被计算为全部图像 token 与该较小描述子集合之间的交叉注意力,从而显著降低计算开销。此外,描述子的紧凑性使得通过分块递归机制在长序列上进行在线推理成为可能,该机制复用前序分块的缓存描述子。实验结果表明,FlashVGGT 的重建精度与 VGGT 相当,同时将 1000 张图像的推理时间缩短至仅 9.3%,并可高效扩展至超过 3000 张图像的序列。

英文原文摘要 1429 字符

3D reconstruction from multi-view images is a core challenge in computer vision. Recently, feed-forward methods have emerged as efficient and robust alternatives to traditional per-scene optimization techniques. Among them, state-of-the-art models like the Visual Geometry Grounding Transformer (VGGT) leverage full self-attention over all image tokens to capture global relationships. However, this approach suffers from poor scalability due to the quadratic complexity of self-attention and the large number of tokens generated in long image sequences.In this work, we introduce FlashVGGT, an efficient alternative that addresses this bottleneck through a descriptor-based attention mechanism. Instead of applying dense global attention across all tokens, FlashVGGT compresses spatial information from each frame into a compact set of **descriptor tokens**. Global attention is then computed as cross-attention between the full set of image tokens and this smaller descriptor set, significantly reducing computational overhead.Moreover, the compactness of the descriptors enables online inference over long sequences via a chunk-recursive mechanism that reuses cached descriptors from previous chunks. Experimental results show that FlashVGGT achieves reconstruction accuracy competitive with VGGT while reducing inference time to just **9.3%** for 1,000 images, and scaling efficiently to sequences exceeding **3,000** images.

标签

会议 CVPR2026
页码 21826-21835
Bibkey
来源 CVF Open Access