3D 视觉与重建 · CVPR2026 ·2026.06.03

MeshWeaver:稀疏体素引导的表面编织用于自回归网格生成

MeshWeaver: Sparse-Voxel-Guided Surface Weaving for Autoregressive Mesh Generation

Jiale Xu、Wang Zhao、Ying Shan

与你有关的部分

把稀疏体素特征同时当作顶点表示、交叉注意力引导和结构脚手架,为自回归网格生成注入局部几何先验;这套「体素编码器 + 下一顶点预测」的范式可直接迁移到点云/网格的自回归建模与高面数资产生成。

原文依据 a multi-level sparse-voxel encoder that injects geometric context into the generative process in three complementary ways
可迁移到 网格生成三维重建自回归生成建模

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

自回归网格生成通过将网格分词为序列并以语言建模方式训练模型而受到关注。然而,现有方法存在两个根本性局限:(i) 分词效率低,导致词元序列过长,无法扩展到高面数网格;(ii) 缺乏几何感知引导,因为生成仅以全局形状嵌入为条件,而非局部表面线索。我们提出 MeshWeaver,一个将网格生成视为表面编织过程的自回归框架,它直接预测下一个顶点而非独立的坐标。其核心是一个多级稀疏体素编码器,以三种互补方式将几何上下文注入生成过程:提供体素特征作为顶点表示、通过交叉注意力对体素特征引导词元预测、以及作为结构脚手架将生成约束在输入表面附近。我们的层次化设计支持在单次解码步骤中实现由粗到细的顶点预测,同时将生成模型与三维几何紧密耦合。大量实验表明,MeshWeaver 实现了 18% 的最优压缩率,能够生成面数高达 16K 的网格,并相较先前方法显著提升了几何保真度。

英文原文摘要 1354 字符

Autoregressive mesh generation has gained attention by tokenizing meshes into sequences and training models in a language-modeling fashion. However, existing approaches suffer from two fundamental limitations: (i) low tokenization efficiency, which yields long token sequences and prevents scaling to high-poly meshes, and (ii) absence of geometry-aware guidance, as generation is conditioned only on global shape embeddings rather than local surface cues. We introduce MeshWeaver, an autoregressive framework that treats mesh generation as a surface weaving process by directly predicting the next vertex instead of independent coordinates. At its core is a multi-level sparse-voxel encoder that injects geometric context into the generative process in three complementary ways: providing voxel features as vertex representations, guiding token prediction via cross-attention to voxel features, and serving as a structural scaffold that constrains generation around the input surface. Our hierarchical design enables coarse-to-fine vertex prediction in a single decoding step, while tightly coupling the generative model with 3D geometry. Extensive experiments demonstrate that MeshWeaver achieves a state-of-the-art compression ratio of 18%, can generate meshes with up to 16K faces, and significantly improves geometric fidelity over prior approaches.

标签

会议 CVPR2026
页码 5912-5922
Bibkey
来源 CVF Open Access