3D 视觉与重建 · CVPR2026 ·2026.06.03

LATTICE:让大规模高保真 3D 生成走向普及

LATTICE: Democratize High-Fidelity 3D Generation at Scale

Zeqiang Lai、Yunfei Zhao、Zibo Zhao、Haolin Liu、Qingxiang Lin、Jingwei Huang 等 8 人

与你有关的部分

VoxSet 把 3D 资产压缩成锚定在粗体素网格上的潜变量集合,使位置嵌入能直接引导生成并支持 token 级测试时扩展;这套半结构化表示可直接迁移到任何需要从稀疏结构生成细节几何的 3D 生成管线。

原文依据 compresses 3D assets into a compact set of latent vectors anchored to a coarse voxel grid
可迁移到 文本到3D生成三维资产重建稀疏体素生成

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

本文提出 LATTICE,一个面向高保真 3D 资产生成的新框架,旨在弥合 3D 与 2D 生成模型在质量与可扩展性上的差距。2D 图像合成受益于固定空间网格与成熟的 Transformer 架构,而 3D 生成由于需要从零开始同时预测空间结构与精细几何表面,从根本上更具挑战性。现有 3D 表示的计算复杂度以及缺乏结构化、可扩展的 3D 资产编码方案,进一步加剧了这些困难。为此,本文提出 VoxSet,一种半结构化表示,将 3D 资产压缩为锚定在粗体素网格上的一组紧凑潜变量,从而实现高效且位置感知的生成。VoxSet 保留了此前 VecSet 方法的简洁性与压缩优势,同时在潜空间中引入显式结构,使位置嵌入能够引导生成,并支持强力的 token 级测试时扩展。基于该表示,LATTICE 采用两阶段流程:首先生成稀疏体素化的几何锚点,随后使用修正流 Transformer 生成精细几何。该方法在核心上十分简洁,却支持任意分辨率解码、低成本训练与灵活的推理方案,在多个方面取得最优性能,是迈向可扩展、高质量 3D 资产创建的重要一步。

英文原文摘要 1493 字符

We present LATTICE, a new framework for high-fidelity 3D asset generation that bridges the quality and scalability gap between 3D and 2D generative models. While 2D image synthesis benefits from fixed spatial grids and well-established transformer architectures, 3D generation remains fundamentally more challenging due to the need to predict both spatial structure and detailed geometric surfaces from scratch. These challenges are exacerbated by the computational complexity of existing 3D representations and the lack of structured and scalable 3D asset encoding schemes. To address this, we propose VoxSet, a semi-structured representation that compresses 3D assets into a compact set of latent vectors anchored to a coarse voxel grid, enabling efficient and position-aware generation. VoxSet retains the simplicity and compression advantages of prior VecSet methods while introducing explicit structure into the latent space, allowing positional embeddings to guide generation and enabling strong token-level test-time scaling. Built upon this representation, LATTICE adopts a two-stage pipeline: first generating a sparse voxelized geometry anchor, then producing detailed geometry using a recitified flow transformer. Our method is simple at its core, but supports arbitrary resolution decoding, low-cost training, and flexible inference schemes, achieving state-of-the-art performance on various aspects, and offering a significant step toward scalable, high-quality 3D asset creation.

标签

会议 CVPR2026
页码 19982-19992
Bibkey
来源 CVF Open Access