WiseEdit:面向认知与创造性图像编辑的基准
WiseEdit: Benchmarking Cognition- and Creativity-Informed Image Editing
为图像编辑模型提供了按「感知—解读—想象」三级认知链和三类知识(陈述性/程序性/元认知)组织的评测框架,可直接用于诊断现有编辑模型在知识推理与创造性构图上的短板,并指导训练数据与能力分解设计。
原文依据 WiseEdit decomposes image editing into three cascaded steps--Awareness, Interpretation, and Imagination
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论近期的图像编辑模型展现出更高层次的智能能力,推动了认知与创造性导向的图像编辑。然而,现有基准的评测范围过于狭窄,无法全面评估这些高级能力。为此,我们提出 WiseEdit,一个知识密集型基准,用于全面评估认知与创造性导向的图像编辑,兼具较深的任务深度与较广的知识广度。类比人类的认知创造过程,WiseEdit 将图像编辑分解为三个级联步骤——感知、解读与想象,每一步对应一个任务,要求模型在该特定步骤上完成挑战。它同时涵盖复杂任务,其中三个步骤均难以轻松完成。此外,WiseEdit 纳入三类基础知识:陈述性知识、程序性知识与元认知知识。最终,WiseEdit 包含 1,220 个测试用例,客观揭示了当前最先进图像编辑模型在基于知识的认知推理与创造性构图能力上的局限。
英文原文摘要 1127 字符
Recent image editing models boast next-level intelligent capabilities, facilitating cognition- and creativity-informed image editing. Yet, existing benchmarks provide too narrow a scope for evaluation, failing to holistically assess these advanced abilities. To address this, we introduce WiseEdit, a knowledge-intensive benchmark for comprehensive evaluation of cognition- and creativity-informed image editing, featuring deep task depth and broad knowledge breadth. Drawing an analogy to human cognitive creation, WiseEdit decomposes image editing into three cascaded steps--Awareness, Interpretation, and Imagination--each corresponding to a task that poses a challenge for models to complete at the specific step. It also encompasses complex tasks, where none of the three steps can be finished easily. Furthermore, WiseEdit incorporates three fundamental types of knowledge: Declarative, Procedural, and Metacognitive knowledge. Ultimately, WiseEdit comprises 1,220 test cases, objectively revealing the limitations of SoTA image editing models in knowledge-based cognitive reasoning and creative composition capabilities.