数据集与评测 · CVPR2026 ·2026.06.03

GGBench:面向统一多模态模型的几何生成推理基准

GGBench: A Geometric Generative Reasoning Benchmark for Unified Multimodal Models

Jingxuan Wei、Caijun Jia、Xi Bai、Xinglong Xu、Siyuan Li、Linzhuang Sun 等 10 人

与你有关的部分

为视觉研究者提供了一个可确定性验证的生成式几何推理评测框架:每个样本对齐自然语言指令、可执行 GeoGebra 代码与渲染图,可用于检验多模态模型「先推理再作图」的能力,并作为训练/评测几何作图与程序化图形生成的数据来源。

原文依据 Each instance in GGBench contains precisely aligned natural-language instructions, executable GeoGebra code, and rendered diagrams
可迁移到 多模态推理评测几何图形生成程序化图像生成视觉语言模型评测

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

统一多模态模型(UMMs)通过在语言、视觉与结构化推理之间耦合感知与生成,正在重新定义人工智能的格局。然而,尽管这类模型日益精细,评测方面仍存在一个关键空白:现有基准大多孤立地衡量判别式理解或无约束生成,忽视了真正的多模态智能所需的集成式生成推理。为弥补这一空白,我们提出 GGBench,这是一个明确为评测几何生成推理而设计的基准——几何生成推理指模型在统一框架内理解、推理并构造解的能力。GGBench 中的每个实例都包含精确对齐的自然语言指令、可执行的 GeoGebra 代码以及渲染出的图形,从而能够对模型的推理与构造保真度进行确定性且可解释的验证。该基准包含 1,411 道经过严格筛选的问题,覆盖八个类别与多个难度等级,共产生超过 7,000 个对齐的可视化结果。我们提出了一套全面的三模态评测协议,通过自动评判与人在回路评判相结合的方式,联合评估文本规划质量、代码可执行性以及所生成图形的几何准确性。针对最优 UMMs 与通用大语言模型(LLMs)的大量实验表明,端到端生成与基于推理的构造之间存在较大的性能差距。GGBench 为测试那些不仅需要理解、还需要构建的多模态系统建立了新的标准,是迈向有依据、可验证的生成式智能的关键一步。

英文原文摘要 1685 字符

Unified Multimodal Models (UMMs) are redefining the landscape of artificial intelligence by coupling perception and generation across language, vision, and structured reasoning. Yet, despite their growing sophistication, a critical gap persists in evaluation: existing benchmarks largely measure discriminative understanding or unconstrained generation in isolation, overlooking the integrated generative reasoning required for genuine multimodal intelligence. To address this, we introduce GGBench, the benchmark explicitly designed to evaluate geometric generative reasoning--the ability of a model to understand, reason about, and construct a solution within a unified framework. Each instance in GGBench contains precisely aligned natural-language instructions, executable GeoGebra code, and rendered diagrams, enabling deterministic and interpretable verification of a model's reasoning and constructive fidelity. The benchmark comprises 1,411 rigorously curated problems covering eight categories and multiple difficulty levels, resulting in over 7,000 aligned visualizations. We propose a comprehensive tri-modal evaluation protocol that jointly assesses textual planning quality, code executability, and geometric accuracy of generated diagrams through both automated and human-in-the-loop judging. Extensive experiments on both state-of-the-art UMMs and general Large Language Models (LLMs) reveal a large performance gap between end-to-end generation and reasoning-grounded construction. GGBench establishes a new standard for testing multimodal systems that must not only understand but also build, marking a crucial step toward grounded, verifiable generative intelligence.

标签

会议 CVPR2026
页码 5199-5210
Bibkey
来源 CVF Open Access