M3DLayout:面向三维生成的多源三维室内布局与结构化描述数据集
M3DLayout: A Multi-Source Dataset of 3D Indoor Layouts and Structured Descriptions for 3D Generation
为文本驱动的三维场景生成提供布局层面的中间表示与大规模多源训练数据,可直接用于训练或评测文本条件扩散/自回归布局生成模型,并支撑语义可控编辑与物理合理性约束。
原文依据 we introduce M3DLayout, a large-scale, multi-source dataset for 3D indoor layout generation
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论在文本驱动的三维场景生成中,物体布局是连接高层语言指令与细粒度几何输出的关键中间表示。它不仅提供确保物理合理性的结构蓝图,还支持语义可控性与交互式编辑。然而,现有数据集在规模、多样性和标注质量上的局限,制约了当前三维室内布局生成模型的学习能力。为解决这一问题,我们提出 M3DLayout,一个面向三维室内布局生成的大规模多源数据集。M3DLayout 包含 21,367 个布局和超过 433k 个物体实例,整合了真实扫描、专业 CAD 设计和程序化生成场景三类不同来源。每个布局都配有详细的结构化文本,描述全局场景概要、大型家具的关系性摆放以及较小物品的细粒度布置。这一多样且标注丰富的资源使模型能够在多种室内环境中学习复杂的空间与语义模式。为评估 M3DLayout 的潜力,我们使用一个文本条件扩散模型和一个文本条件自回归模型建立了基准。实验结果表明,该数据集为训练布局生成模型提供了坚实基础。其多源构成增强了多样性,尤其是 Inf3DLayout 子集提供了丰富的小物体信息,使生成更复杂、更精细的场景成为可能。我们希望 M3DLayout 能成为推进文本驱动三维场景合成研究的宝贵资源。所有数据集与代码将在论文录用后公开。
英文原文摘要 1755 字符
In text-driven 3D scene generation, object layout serves as a crucial intermediate representation that bridges high-level language instructions with detailed geometric output. It not only provides a structural blueprint for ensuring physical plausibility but also supports semantic controllability and interactive editing. However, the learning capabilities of current 3D indoor layout generation models are constrained by the limited scale, diversity, and annotation quality of existing datasets. To address this, we introduce M3DLayout, a large-scale, multi-source dataset for 3D indoor layout generation. M3DLayout comprises 21,367 layouts and over 433k object instances, integrating three distinct sources: real-world scans, professional CAD designs, and procedurally generated scenes. Each layout is paired with detailed structured text describing global scene summaries, relational placements of large furniture, and fine-grained arrangements of smaller items. This diverse and richly annotated resource enables models to learn complex spatial and semantic patterns across a wide variety of indoor environments. To assess the potential of M3DLayout, we establish a benchmark using both a text-conditioned diffusion model and a text-conditioned autoregressive model. Experimental results demonstrate that our dataset provides a solid foundation for training layout generation models. Its multi-source composition enhances diversity, notably through the Inf3DLayout subset which provides rich small-object information, enabling the generation of more complex and detailed scenes. We hope that M3DLayout can serve as a valuable resource for advancing research in text-driven 3D scene synthesis. All dataset and code will be made public upon acceptance.