生成模型与扩散 · CVPR2026 ·2026.06.03

RenderFlow:基于流匹配的单步神经渲染

RenderFlow: Single-Step Neural Rendering via Flow Matching

Shenghao Zhang、Runtao Liu、Christopher Schroers、Yang Zhang

与你有关的部分

用流匹配把扩散式神经渲染压成确定性单步前向,并给出稀疏关键帧引导与轻量 adapter 复用同一前向模型做逆渲染(本征分解),可直接迁移到任何需要低延迟、时序一致的生成式渲染或图像到图像回归任务。

原文依据 we propose a novel, end-to-end, deterministic single-step neural rendering framework RenderFlow built upon a flow matching paradigm
可迁移到 神经渲染逆渲染与本征分解图像到图像翻译

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

传统基于物理的渲染(PBR)管线通过计算代价高昂的光传输模拟来生成照片级真实感图像。尽管近期的深度学习方法借助扩散模型先验与几何缓冲(G-buffer)在无需显式场景几何或光照模拟的情况下也能产生视觉上颇具吸引力的结果,但它们仍受两个主要局限的制约。其一,扩散过程的迭代特性带来了可观的延迟。其二,这类生成模型固有的随机性损害了物理准确性与时序一致性。为应对这些挑战,我们提出了一种新颖的、端到端的、确定性的单步神经渲染框架 RenderFlow,它建立在流匹配范式之上。为进一步提升渲染质量与泛化能力,我们提出了一个高效且有效的稀疏关键帧引导模块。我们的方法显著加速了渲染过程,并且通过可选地引入稀疏渲染的关键帧作为引导,增强了输出的物理合理性与整体视觉质量。由此得到的管线以照片级真实的渲染质量实现了接近实时的性能,有效弥合了现代生成模型的效率与传统基于物理渲染的精度之间的差距。此外,我们通过引入一个轻量的、基于适配器的模块,将该预训练前向模型高效地复用于本征分解这一逆渲染任务,从而展示了我们框架的多功能性。

英文原文摘要 1589 字符

Conventional physically-based rendering (PBR) pipelines generate photorealistic images through computationally expensive light transport simulations. Although recent deep learning approaches leverage diffusion model priors with geometry buffers (G-buffers) to produce visually compelling results without explicit scene geometry or light simulation, they remain constrained by two major limitations. First, the iterative nature of the diffusion process introduces substantial latency. Second, the inherent stochasticity of these generative models compromises physical accuracy and temporal consistency. In response to these challenges, we propose a novel, end-to-end, deterministic single-step neural rendering framework RenderFlow built upon a flow matching paradigm. To further strengthen both rendering quality and generalization, we propose an efficient and effective module for sparse keyframe guidance. Our method significantly accelerates the rendering process and, by optionally incorporating sparsely rendered keyframes as guidance, enhances both the physical plausibility and overall visual quality of the output. The resulting pipeline achieves near real-time performance with photorealistic rendering quality, effectively bridging the gap between the efficiency of modern generative models and the precision of traditional physically based rendering. Furthermore, we demonstrate the versatility of our framework by introducing a lightweight, adapter-based module that efficiently repurposes the pretrained forward model for the inverse rendering task of intrinsic decomposition.

标签

会议 CVPR2026
页码 40602-40611
Bibkey
来源 CVF Open Access