保持 SymPL:面向视觉语言模型异中心空间推理的符号投影布局
Keep it SymPL: Symbolic Projective Layout for Allocentric Spatial Reasoning in Vision-Language Models
把异中心(物体中心)视角的空间问题转成符号化布局表示再交给 VLM,这个「投影+抽象+二分+定位」的重构思路可直接用于提升 VLM 在三维场景理解、多视图问答和视角变换类任务上的表现。
原文依据 reformulates allocentric reasoning into symbolic-layout forms that VLMs inherently handle well
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论视角感知的空间推理涉及从特定视角理解空间关系——或以观察者为中心(自我中心),或以物体为中心(异中心)。尽管视觉语言模型(VLM)在自我中心设定下表现良好,但当需要从异中心视角进行推理时,其性能会下降,此时空间关系必须从场景中物体的视角来推断。本研究针对这一尚未充分探索的挑战,提出了符号投影布局(Symbolic Projective Layout, SymPL),该框架将异中心推理重构为 VLM 本身擅长处理的符号化布局形式。借助投影、抽象、二分与定位这四个关键要素,SymPL 将异中心问题转换为结构化的符号化布局表示。大量实验表明,这一重构在异中心与自我中心任务上均显著提升了性能,增强了在视觉幻觉与多视图场景下的鲁棒性,并且每个组成部分都对上述增益起到关键作用。这些结果表明,SymPL 为处理复杂的视角感知空间推理提供了一种有效且有原则的方法。
英文原文摘要 1208 字符
Perspective-aware spatial reasoning involves understanding spatial relationships from specific viewpoints--either egocentric (observer-centered) or allocentric (object-centered).While vision-language models (VLMs) perform well in egocentric settings, their performance deteriorates when reasoning from allocentric viewpoints, where spatial relations must be inferred from the perspective of objects within the scene.In this study, we address this underexplored challenge by introducing Symbolic Projective Layout (SymPL), a framework that reformulates allocentric reasoning into symbolic-layout forms that VLMs inherently handle well.By leveraging four key factors--projection, abstraction, bipartition, and localization--SymPL converts allocentric questions into structured symbolic-layout representations.Extensive experiments demonstrate that this reformulation substantially improves performance in both allocentric and egocentric tasks, enhances robustness under visual illusions and multi-view scenarios, and that each component contributes critically to these gains.These results show that SymPL provides an effective and principled approach for addressing complex perspective-aware spatial reasoning.