Yo'City:基于自评论扩展的个性化无边界三维真实感城市场景生成
Yo'City: Personalized and Boundless 3D Realistic City Scene Generation via Self-Critic Expansion
把大模型智能体(全局规划器 + 局部设计器)与等距图像合成、图像到三维生成串联成可无限扩展的城市场景流水线,并用场景图做距离与语义感知的布局优化;对做三维场景生成的人,这是一套可复用的「语言规划→二维等距图→三维资产」分层生成范式与配套评测指标。
原文依据 the grid-level 3D generation is achieved through a produce-refine-evaluate isometric image synthesis loop, followed by image-to-3D generation
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论真实感三维城市生成是虚拟现实与数字孪生等广泛应用的基础。然而,现有方法大多依赖训练单一扩散模型,这限制了其生成个性化、无边界城市级场景的能力。本文提出 Yo'City,一种新颖的智能体框架,利用现成大模型的推理与组合能力,实现用户定制且可无限扩展的三维城市生成。具体而言,Yo'City 首先通过自顶向下的规划策略对城市进行概念化,定义分层的「城市—街区—网格」结构:全局规划器确定整体布局与潜在功能街区,局部设计器则进一步以网格级描述细化每个街区。随后,网格级三维生成通过「生成—精修—评估」的等距图像合成循环完成,并接续图像到三维的生成。为模拟城市的持续演化,Yo'City 进一步引入用户交互式、关系引导的扩展机制,执行基于场景图的距离与语义感知布局优化,确保城市在空间上连贯生长。为全面评估本方法,我们构建了一个多样化的基准数据集,并设计了六项多维度指标,从语义、几何、纹理与布局等角度评估生成质量。大量实验表明,Yo'City 在所有评估方面均持续优于现有最优方法。
英文原文摘要 1599 字符
Realistic 3D city generation is fundamental to a wide range of applications, including virtual reality and digital twins. However, most existing methods rely on training a single diffusion model, which limits their ability to generate personalized and boundless city-scale scenes. In this paper, we present Yo'City, a novel agentic framework that enables user-customized and infinitely expandable 3D city generation by leveraging the reasoning and compositional capabilities of off-the-shelf large models. Specifically, Yo'City first conceptualizes the city through a top-down planning strategy that defines a hierarchical "City-District-Grid" structure. The Global Planner determines the overall layout and potential functional districts, while the Local Designer further refines each district with detailed grid-level descriptions. Subsequently, the grid-level 3D generation is achieved through a produce-refine-evaluate isometric image synthesis loop, followed by image-to-3D generation. To simulate continuous city evolution, Yo'City further introduces a user-interactive, relationship-guided expansion mechanism, which performs scene graph-based distance- and semantics-aware layout optimization, ensuring spatially coherent city growth. To comprehensively evaluate our method, we construct a diverse benchmark dataset and design six multi-dimensional metrics that assess generation quality from the perspectives of semantics, geometry, texture, and layout. Extensive experiments demonstrate that Yo'City consistently outperforms existing state-of-the-art methods across all evaluation aspects.