PSDesigner:具备类人创意工作流的自动化平面设计
PSDesigner: Automated Graphic Design with a Human-Like Creative Workflow
把图形设计建模为 MLLM 驱动的工具调用序列,在可编辑 PSD 文件上做资产检索、插入与元素精修;其 CreativePSD 数据集(带操作轨迹的 PSD 文件)可作为视觉研究者研究「可编辑分层图像生成/编辑」与「指令到操作序列」的监督来源。
原文依据 autonomously infers and executes tool calls to manipulate design files, such as integrating new assets or refining inferior elements
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论平面设计是一个富有创造性与创新性的过程,在电商和广告等应用中起着至关重要的作用。然而,构建一个能够将用户意图忠实转化为可编辑设计文件的自动化设计系统仍是一个开放挑战。尽管近期研究已利用强大的文本到图像模型和多模态大语言模型来辅助平面设计,但它们通常简化了专业工作流,导致灵活性和直观性有限。为解决这些局限,我们提出 PSDesigner,一个模拟人类设计师创意工作流的自动化平面设计系统。PSDesigner 基于多个专用组件,根据用户指令收集与主题相关的素材,并自主推断并执行工具调用以操作设计文件,例如整合新素材或精修劣质元素。为使系统具备强大的工具使用能力,我们构建了一个设计数据集 CreativePSD,其中包含大量高质量的 PSD 设计文件,并标注了覆盖广泛设计场景与艺术风格的操作轨迹,使模型能够学习专家的设计流程。大量实验表明,PSDesigner 在多种平面设计任务上优于现有方法,使非专业人士也能便捷地创作出生产级质量的设计。
英文原文摘要 1403 字符
Graphic design is a creative and innovative process that plays a crucial role in applications such as e-commerce and advertising. However, developing an automated design system that can faithfully translate user intentions into editable design files remains an open challenge. Although recent studies have leveraged powerful text-to-image models and MLLMs to assist graphic design, they typically simplify professional workflows, resulting in limited flexibility and intuitiveness. To address these limitations, we propose ***PSDesigner***, an automated graphic design system that emulates the creative workflow of human designers. Building upon multiple specialized components, ***PSDesigner*** collects theme-related assets based on user instructions, and autonomously infers and executes tool calls to manipulate design files, such as integrating new assets or refining inferior elements. To endow the system with strong tool-use capabilities, we construct a design dataset, ***CreativePSD***, which contains a large amount of high-quality PSD design files annotated with operation traces across a wide range of design scenarios and artistic styles, enabling models to learn expert design procedures. Extensive experiments demonstrate that ***PSDesigner*** outperforms existing methods across diverse graphic design tasks, empowering non-specialists to conveniently create production-quality designs.