ViStoryBench：面向故事可视化的综合基准套件
ViStoryBench: Comprehensive Benchmark Suite for Story Visualization
为故事可视化/多图叙事生成提供了带角色参考、多镜头脚本与人工校验的评测基准，并给出角色一致性、风格相似度、提示词对齐、美学质量与复制粘贴伪影等自动指标，可直接用于诊断多图生成模型的角色漂移与跨图一致性问题。
原文依据 ViStoryBench proposes a suite of multi-dimensional automated metrics to evaluate character consistency, style similarity, prompt alignment, aesthetic quality, and artifacts like copy-paste behavior.
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论故事可视化旨在生成连贯的图像序列，忠实呈现叙事内容并与给定的角色参考相匹配。尽管生成模型取得了进展，现有基准仍范围狭窄，往往局限于短提示词、缺少角色参考或仅涉及单张图像的情形，无法反映真实叙事的复杂性，也掩盖了模型的真实性能。我们提出 ViStoryBench，一个综合基准，用于在多样的叙事结构、视觉风格与角色设定下评估故事可视化模型。它包含标注丰富的多镜头脚本，这些脚本源自涵盖文学、电影与民间传说的精选故事。大语言模型协助进行故事摘要与脚本生成，所有输出均经人工校验以确保连贯性与忠实度。角色参考经过精心整理，以在不同艺术风格间保持一致性。ViStoryBench 提出一套多维度自动指标，用于评估角色一致性、风格相似度、提示词对齐、美学质量以及复制粘贴行为等伪影。这些指标经人工研究验证，并被用于评估广泛的开放源代码与商业模型，从而实现系统化分析并推动视觉叙事领域的进步。
英文原文摘要 1326 字符
Story visualization aims to generate coherent image sequences that faithfully represent a narrative and match given character references. Despite progress in generative models, existing benchmarks remain narrow in scope, often limited to short prompts, lacking character references, or single-image cases, failing to reflect real-world narrative complexity and obscuring true model performance. We introduce ViStoryBench, a comprehensive benchmark designed to evaluate story visualization models across varied narrative structures, visual styles, and character settings. It features richly annotated multi-shot scripts derived from curated stories spanning literature, film, and folklore. Large language models assist in story summarization and script generation, with all outputs verified by humans for coherence and fidelity. Character references are carefully curated to maintain consistency across different artistic styles. ViStoryBench proposes a suite of multi-dimensional automated metrics to evaluate character consistency, style similarity, prompt alignment, aesthetic quality, and artifacts like copy-paste behavior. These metrics are validated through human studies and used to assess a broad range of open-source and commercial models, enabling systematic analysis and encouraging advances in visual storytelling.