自监督与表征学习 · CVPR2026 ·2026.06.03 分类待复核 · 置信度 0.55

建模人类草图的视觉歧义性

Modeling the Visual Ambiguity of Human Sketches

Yang Zhou、Ping Ni、Jin Wang、Senyun Jia、Jingdan Yan、Kaixiang Huang 等 9 人

与你有关的部分

AmbiScore 把「草图-图像对本身有多歧义」量化成一个可计算的指标,并据此自适应调节监督强度;做跨模态对齐或噪声监督训练时,可以直接借用这种按样本不确定性加权监督的思路,Purified Matching 的 shape jigsaw / texture swapping 也可作为解耦结构与外观的通用数据构造手段。

原文依据 we introduce AmbiScore, a metric that quantifies the ambiguity of sketch-image pairs
可迁移到 零样本草图检索跨模态检索草图-图像匹配

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

人类草图是一种紧凑而富有表现力的视觉交流形式,但其稀疏的结构线索在捕捉物体本质结构的同时也引入了歧义:同一张草图可以对应多张合理的图像,从而使跨域对齐变得不确定且不稳定。这种歧义从根本上限制了依赖精确草图—图像对应关系的草图视觉任务。为应对这一挑战,我们提出 AmbiScore,一种量化草图—图像对歧义程度的指标,并以零样本草图图像检索(ZS-SBIR)作为试验平台,揭示歧义性监督如何导致现有方法性能崩溃。我们进一步提出 DisAmb(解耦歧义)框架,通过两个组件显式建模并缓解歧义:(1)弹性匹配,利用 AmbiScore 自适应调整监督强度;(2)纯化匹配,借助与歧义无关的掩码,通过形状拼图与纹理交换解耦结构与外观。DisAmb 在高歧义条件下建立了新的基准,并为下游草图引导任务提供了稳健、可迁移的监督信号。

英文原文摘要 1194 字符

Human sketches provide a compact and expressive form of visual communication, but their sparse structural cues, while capturing essential object structures, introduce ambiguity because a single sketch can correspond to multiple plausible images, making cross-domain alignment uncertain and unstable. Such ambiguity fundamentally limits sketch-based vision tasks that rely on precise sketch--image correspondence. To address this challenge, we introduce AmbiScore, a metric that quantifies the ambiguity of sketch-image pairs, and use Zero-Shot Sketch-Based Image Retrieval (ZS-SBIR) as a testbed to reveal how ambiguous supervision leads to performance collapse in existing methods. We further propose DisAmb (Disentangling Ambiguity), a framework that explicitly models and mitigates ambiguity through two components: (1) Elastic Matching, which adaptively adjusts supervision strength using AmbiScore, and (2) Purified Matching, which employs ambiguity-agnostic masks to disentangle structure and appearance via shape jigsaw and texture swapping. DisAmb establishes new benchmarks under high ambiguity and provides a robust, transferable supervisory signal for downstream sketch-guided tasks.

标签

会议 CVPR2026
页码 16876-16886
Bibkey
来源 CVF Open Access