鲁棒性与安全 · CVPR2026 ·2026.06.03

LayoutAD:面向场景布局异常检测的语义-几何错位推理探索

LayoutAD: Exploring Semantic-Geometric Misalignment Reasoning for Scene Layout Anomaly Detection

Zhichao Zeng、Jiasheng Zhang、Jiyun Sun、Jiangtao Cui、Xiaotian Qiao

与你有关的部分

把「布局异常」形式化为对象级语义图与几何图的错位推理,可复用于检测文生图模型的幻觉与关系错误,也可作为视频异常检测与自校正生成的即插即用判别器。

原文依据 we propose LayoutAD, an unsupervised learning framework that constructs semantic and geometric graphs to jointly reason over semantic-geometric misalignment among objects
可迁移到 visual anomaly detectionscene graph generationtext-to-image hallucination detectionvideo anomaly detection

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

视觉异常检测通过识别偏离正常模式的样本,在质量控制应用中至关重要。以往的结构异常或逻辑异常检测方法主要关注纹理缺陷、重建误差等像素级偏差,忽略了对象级的结构与上下文不一致性。这些被忽视的布局异常仍然关键却研究不足,例如生成式文生图模型中出现的与事实不符的幻觉。基于上述观察,本文提出场景布局异常检测这一新任务,即从输入图像预测对象级异常图,以揭示场景中每个对象的语义合理性与几何一致性。具体而言,我们提出 LayoutAD,一个无监督学习框架,通过构建语义图与几何图,对对象间的语义-几何错位进行联合推理。在该形式化框架下,我们能够检测多种布局偏差,包括对象属性不合理与关系不匹配。大量实验表明,LayoutAD 在多种场景下在定性与定量上均优于基线方法,并有助于视频异常检测与自校正图像生成等场景理解与生成应用。

英文原文摘要 1318 字符

Visual anomaly detection is vital for quality control applications by identifying deviations from normal patterns. Previous structural or logical anomaly detection methods mainly focus on pixel-level deviations like texture defects and reconstruction errors, ignoring the object-level structural and contextual inconsistencies. These overlooked layout anomalies remain critical yet underexplored, e.g., factually defective hallucinations appeared in generative text-to-image models. Based on the above observation, in this paper, we introduce scene layout anomaly detection, a new task that predicts an object-level anomaly map from the input image to reveal the semantic plausibility and geometric consistency of each object in the scene. Specifically, we propose LayoutAD, an unsupervised learning framework that constructs semantic and geometric graphs to jointly reason over semantic-geometric misalignment among objects. Under this formulation, we are able to detect diverse layout deviations, including object attribute implausibilities and relationship mismatches. Extensive experiments show that LayoutAD outperforms baselines qualitatively and quantitatively across various scenarios, benefiting scene understanding and generation applications like video anomaly detection and self-corrected image generation.

标签

会议 CVPR2026
页码 35567-35576
Bibkey
来源 CVF Open Access