E-comIQ-ZH:面向电商海报细粒度评测的人类对齐数据集与基准(含思维链)
E-comIQ-ZH: A Human-Aligned Dataset and Benchmark for Fine-Grained Evaluation of E-commerce Posters with Chain-of-Thought
为生成图像质量评估提供了一条可复用的路线:用专家校准的 CoT 理由训练专用评测模型,可迁移到其他需要细粒度、可解释打分的生成内容评测场景(如中文文字渲染正确性、版式功能性)。
原文依据 we introduce E-comIQ-ZH, a framework for evaluating Chinese e-commerce posters
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论生成式人工智能被广泛用于制作商业海报。然而,生成技术的快速进步已远超自动化质量评估的能力。现有模型侧重通用美学或低层失真,缺乏电商设计所需的功能性标准。对于中文内容而言这一挑战尤为突出:复杂汉字常产生细微却关键的文本伪影,而现有方法往往忽略这些伪影。为解决该问题,我们提出 E-comIQ-ZH,一个用于评估中文电商海报的框架。我们构建了首个数据集 E-comIQ-18k,其特点是包含多维度评分与经专家校准的思维链(CoT)理由。基于该数据集,我们训练了 E-comIQ-M,一个与人类专家判断对齐的专用评估模型。我们的框架还支撑了 E-comIQ-Bench,这是首个面向中文电商海报生成的自动化、可扩展基准。大量实验表明,E-comIQ-M 与专家标准更为接近,并能够实现电商海报的可扩展自动化评估。所有数据集、模型与评估工具都将公开,以支持该领域的后续研究。
英文原文摘要 1161 字符
Generative AI is widely used to create commercial posters. However, rapid advances in generation have outpaced automated quality assessment. Existing models emphasize generic esthetics or low level distortions and lack the functional criteria required for e-commerce design. It is especially challenging for Chinese content, where complex characters often produce subtle but critical textual artifacts that are overlooked by existing methods. To address this, we introduce E-comIQ-ZH, a framework for evaluating Chinese e-commerce posters. We build the first dataset E-comIQ-18k to feature multi dimensional scores and expert calibrated Chain of Thought (CoT) rationales. Using this dataset, we train E-comIQ-M, a specialized evaluation model that aligns with human expert judgment. Our framework enables E-comIQ-Bench, the first automated and scalable benchmark for the generation of Chinese e-commerce posters. Extensive experiments show our E-comIQ-M aligns more closely with expert standards and enables scalable automated assessment of e-commerce posters. All datasets, models, and evaluation tools will be released to support future research in this area.