双先验文本-相位协同网络用于无监督跨域图像检索
Text-Phase Synergy Network with Dual Priors for Unsupervised Cross-Domain Image Retrieval
利用CLIP生成的域特定提示作为文本先验提供语义监督,并引入域不变相位特征作为相位先验桥接域分布差距,为无监督跨域检索提供可复用的双先验协同框架。
原文依据 we first employ CLIP to generate a set of class-specific prompts per domain, termed as domain prompt, serving as a text prior
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论本文研究无监督跨域图像检索(UCDIR),其目标是在不依赖标注数据的情况下跨不同域检索同一类别的图像。现有方法通常利用聚类算法得到的伪标签作为监督信号,进行域内表征学习和跨域特征对齐。然而,这些离散伪标签往往无法提供准确且全面的语义指导。此外,对齐过程常常忽略域特定信息与语义信息之间的纠缠,导致学习到的表征出现语义退化,最终损害检索性能。本文通过提出双先验文本-相位协同网络(TPSNet)来解决上述局限。具体而言,我们首先采用CLIP为每个域生成一组类别特定的提示,称为域提示,作为文本先验以提供更精确的语义监督。同时,我们进一步引入相位先验,以域不变相位特征表示,并将其集成到原始图像表征中以弥合域分布差距,同时保持语义完整性。借助这两种先验的协同作用,TPSNet在UCDIR基准上显著优于最优方法。
英文原文摘要 1351 字符
This paper studies unsupervised cross-domain image retrieval (UCDIR), which aims to retrieve images of the same category across different domains without relying on labeled data. Existing methods typically utilize pseudo-labels, derived from clustering algorithms, as supervisory signals for intra-domain representation learning and cross-domain feature alignment. However, these discrete pseudo-labels often fail to provide accurate and comprehensive semantic guidance. Moreover, the alignment process frequently overlooks the entanglement between domain-specific and semantic information, leading to semantic degradation in the learned representations and ultimately impairing retrieval performance. This paper addresses the limitations by proposing a Text-Phase Synergy Network with Dual Priors (TPSNet). Specifically, we first employ CLIP to generate a set of class-specific prompts per domain, termed as domain prompt, serving as a text prior that offers more precise semantic supervision. In parallel, we further introduce a phase prior, represented by domain-invariant phase features, which is integrated into the original image representations to bridge the domain distribution gaps while preserving semantic integrity. Leveraging the synergy of these dual priors, TPSNet significantly outperforms state-of-the-art methods on UCDIR benchmarks.