看穿噪声:提升视线估计中的域泛化能力
See Through the Noise: Improving Domain Generalization in Gaze Estimation
针对视线估计中标签噪声损害域泛化的问题,提出基于原型变换构建语义嵌入空间、利用特征-标签亲和一致性区分噪声样本,并在语义流形上施加亲和正则化,为视觉任务中处理噪声标签提供可复用思路。
原文依据 we propose a novel solution, called See-Through-Noise (SeeTN) framework, which improves generalization from a novel perspective of mitigating label noise.
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论可泛化的视线估计方法因其在现实应用中的关键重要性而日益受到关注,并已取得显著进展。然而,这些方法往往忽略了标签噪声——由获取精确视线标注的内在困难所引起——对模型泛化性能的影响。本文首次全面研究了标签噪声对视线估计泛化的负面影响。进一步,我们提出了一种新颖的解决方案,称为看穿噪声(SeeTN)框架,它从缓解标签噪声的新视角提升泛化能力。具体而言,我们提出通过基于原型的变换构建语义嵌入空间,以保持视线特征与连续标签之间一致的拓扑结构。然后,我们测量特征-标签亲和一致性以区分噪声样本与干净样本,并在语义流形中引入一种新颖的亲和正则化,将视线相关信息从干净样本迁移到噪声样本。我们提出的SeeTN促进了语义结构对齐并强制了域不变的视线关系,从而增强了对标签噪声的鲁棒性。大量实验表明,我们的SeeTN有效缓解了源域噪声的不利影响,在不损害源域准确率的情况下实现了更优的跨域泛化,并凸显了在广义视线估计中显式处理噪声的重要性。
英文原文摘要 1523 字符
Generalizable gaze estimation methods have garnered increasing attention due to their critical importance in real-world applications and have achieved significant progress. However, they often overlook the effect of label noise, arising from the inherent difficulty of acquiring precise gaze annotations, on model generalization performance. In this paper, we are the first to comprehensively investigate the negative effects of label noise on generalization in gaze estimation. Further, we propose a novel solution, called See-Through-Noise (SeeTN) framework, which improves generalization from a novel perspective of mitigating label noise. Specifically, we propose to construct a semantic embedding space via a prototype-based transformation to preserve a consistent topological structure between gaze features and continuous labels. We then measure feature-label affinity consistency to distinguish noisy from clean samples, and introduce a novel affinity regularization in the semantic manifold to transfer gaze-related information from clean to noisy samples. Our proposed SeeTN promotes semantic structure alignment and enforces domain-invariant gaze relationships, thereby enhancing robustness against label noise. Extensive experiments demonstrate that our SeeTN effectively mitigates the adverse impact of source-domain noise, leading to superior cross-domain generalization without compromising the source-domain accuracy, and highlight the importance of explicitly handling noise in generalized gaze estimation.