3D 视觉与重建 · CVPR2026 ·2026.06.03

HumanNOVA:从单张图像生成照片级真实、通用且快速的3D人体化身模型

HumanNOVA: Photorealistic, Universal and Rapid 3D Human Avatar Modeling from a Single Image

Hezhen Hu、Wangbo Zhao、Lanqing Guo、Hanwen Jiang、Jonathan C. Liu、Zhiwen Fan 等 9 人

与你有关的部分

提出一种前馈式、以词元为条件的单图人体化身建模框架,利用跨注意力将图像与SMPL词元融合为三平面表示,无需测试时优化即可在1秒内生成逼真3D人体,为快速3D重建与可控生成提供可复用范式。

原文依据 a feed-forward, token-conditioned avatar modeling framework that allows fast inference in less than one second and requires no test-time optimization
可迁移到 单图三维人体重建三维化身生成新视角合成

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

本文提出HumanNOVA,一种从单张RGB图像生成照片级真实、通用且快速的3D人体化身模型。由于缺乏多样且高质量的3D人体数据,同时实现照片级真实感和泛化能力颇具挑战。为此,我们构建了一个可扩展的数据生成流程,遵循两种策略。第一种策略是利用现有的绑定资产,并用日常生活中的大量姿态对其进行动画化。第二种策略是利用现有的多相机人体捕捉数据,并通过拟合生成更多样化的视角用于训练。这两种策略使我们能够将数据规模扩展至10万个资产,显著提升了数据的数量与多样性,从而支持鲁棒模型训练。在架构方面,HumanNOVA采用前馈式、以词元为条件的化身建模框架,支持不到一秒的快速推理,且无需测试时优化。给定输入图像和估计的简化人体网格(SMPL)(不含详细几何或外观),模型首先将两种输入编码为紧凑的词元表示。这些词元随后作为条件信号,通过交叉注意力融合,以构建基于三平面的3D化身表示。在多个基准上的大量实验表明,我们的方法在定量和定性上均具有优越性,并且在多样化的输入图像条件下表现出鲁棒性。项目页面:https://HumanNOVA.github.io。

英文原文摘要 1507 字符

In this paper, we present HumanNOVA, a photorealistic, universal, and rapid model for generating 3D human avatars from a single RGB image. Achieving both photorealism and generalization is challenging due to the scarcity of diverse, high-quality 3D human data. To address this, we build a scalable data generation pipeline that follows two strategies. The first one is to leverage existing rigged assets and animate them with extensive poses from daily life. The second strategy is to utilize existing multi-camera captures of humans and employ fitting to generate more diverse views for training. These two strategies enable us to scale up to 100k assets, significantly enhancing both the quantity and the diversity of data for robust model training. In terms of the architecture, HumanNOVA adopts a feed-forward, token-conditioned avatar modeling framework that allows fast inference in less than one second and requires no test-time optimization. Given an input image and an estimated simplified human mesh (SMPL) without detailed geometry or appearance, the model first encodes both inputs into compact token representations. These tokens then act as conditioning signals and are fused through cross-attention to construct a triplane-based 3D avatar representation. Extensive experiments on multiple benchmarks demonstrate the superiority of our approach, both quantitatively and qualitatively, as well as its robustness under diverse input image conditions. Project page at https://HumanNOVA.github.io.

标签

会议 CVPR2026
页码 18096-18106
Bibkey
来源 CVF Open Access