CADFS:面向大语言模型辅助计算机辅助设计的大规模 CAD 程序数据集与框架
CADFS: A Big CAD Program Dataset and Framework for Computer-Aided Design with Large Language Models
把 CAD 建模历史表示为可执行的 FeatureScript 程序,并用多模态标注微调 VLM,使视觉语言模型能够从文本或图像生成复杂 CAD 设计历史;这套「程序化序列表示 + 多模态标注」的思路可迁移到其他需要结构化程序输出的视觉生成任务。
原文依据 Fine-tuning a VLM on this representation yields state-of-the-art results in text-conditioned CAD generation and image-based reconstruction
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论我们提出 CADFS,一个以数据为中心的框架,使大型视觉语言模型能够生成复杂的 CAD 设计历史。现有的生成式 CAD 系统受限于简化的表示和有限的数据集,只能执行草图-拉伸操作。为解决这一问题,我们引入基于 FeatureScript 的表示,并构建了一个包含 45 万个真实世界 CAD 模型、覆盖 15 种建模操作的数据集。我们通过一条新的流水线获得该数据集,该流水线重建干净、可执行的 FeatureScript 程序并提供多模态标注。在该表示上微调 VLM,在文本条件 CAD 生成和基于图像的重建上取得了最优结果,生成的设计比先前框架更准确、更多样、特征更丰富。消融实验表明,我们框架的每个单独组件,即 FeatureScript 表示、扩展的操作集以及表示对齐的文本描述,都显著提升了性能。我们的框架大幅拓宽了生成式 CAD 所能达到的复杂度和真实感。CADFS 框架和新数据集可在 https://voyleg.github.io/cadfs/ 获取。
英文原文摘要 1178 字符
We introduce CADFS, a data-centric framework that enables large vision-language models to generate complex CAD design histories. Existing generative CAD systems are restricted to sketch-extrude operations due to simplified representations and limited datasets. We address this by introducing a FeatureScript-based representation and constructing a dataset of 450k real-world CAD models spanning 15 modeling operations. We obtain the dataset via a new pipeline that reconstructs clean, executable FeatureScript programs and provides multimodal annotations. Fine-tuning a VLM on this representation yields state-of-the-art results in text-conditioned CAD generation and image-based reconstruction, producing more accurate, diverse, and feature-rich designs than prior frameworks. Ablations show that each individual component of our framework, i.e., the FeatureScript representation, the extended operation set, and representation-aligned textual descriptions, significantly improves performance. Our framework substantially broadens the complexity and realism achievable in generative CAD. The CADFS framework and the new dataset are available at https://voyleg.github.io/cadfs/.