魔鬼藏在梯度纠缠中:面向鲁棒广义类别发现的能量感知梯度协调器
The Devil Is in Gradient Entanglement: Energy-Aware Gradient Coordinator for Robust Generalized Category Discovery
把「梯度纠缠」作为可诊断的优化失效模式,并用参考模型锚定有监督梯度方向、用能量系数自适应缩放无监督梯度投影,这套梯度级插件可直接移植到任何半监督/开放词表表征学习流程中,无需改动网络结构。
原文依据 we identify a key issue, i.e., gradient entanglement, which 1) distorts supervised gradients and weakens discrimination among known classes
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论广义类别发现(GCD)利用有标注数据对来自已知或未知类别的无标注样本进行分类。以往大多数方法联合优化有监督与无监督目标,并取得了有前景的结果。然而,固有的优化干扰仍限制其进一步提升。通过定量分析,我们识别出一个关键问题,即梯度纠缠,它 1)扭曲有监督梯度并削弱已知类别之间的判别性,2)在已知类与新颖类之间诱发表征子空间重叠,降低新颖类别的可分性。为解决该问题,我们提出能量感知梯度协调器(EAGC),这是一个即插即用的梯度级模块,显式地调控优化过程。EAGC 包含两个组件:基于锚框的梯度对齐(AGA)与能量感知弹性投影(EEP)。AGA 引入一个参考模型来锚定有标注样本的梯度方向,从而在有标注梯度干扰下保持已知类别的判别结构。EEP 将无标注梯度软投影到已知类子空间的补空间上,并推导出一个基于能量的系数,依据每个无标注样本与已知子空间的对齐程度自适应地缩放其投影,从而在减少子空间重叠的同时,不压制那些很可能属于已知类别的无标注样本。实验表明,EAGC 能持续提升现有方法并建立新的最优结果。代码见 https://haiyangzheng.github.io/EAGC。
英文原文摘要 1624 字符
Generalized Category Discovery (GCD) leverages labeled data to categorize unlabeled samples from known or unknown classes. Most previous methods jointly optimize supervised and unsupervised objectives and achieve promising results. However, inherent optimization interference still limits their ability to improve further. Through quantitative analysis, we identify a key issue, i.e., gradient entanglement, which 1) distorts supervised gradients and weakens discrimination among known classes, and 2) induces representation-subspace overlap between known and novel classes, reducing the separability of novel categories. To address this issue, we propose the Energy-Aware Gradient Coordinator (EAGC), a plug-and-play gradient-level module that explicitly regulates the optimization process. EAGC comprises two components: Anchor-based Gradient Alignment (AGA) and Energy-aware Elastic Projection (EEP). AGA introduces a reference model to anchor the gradient directions of labeled samples, preserving the discriminative structure of known classes against the interference of unlabeled gradients. EEP softly projects unlabeled gradients onto the complement of the known-class subspace and derives an energy-based coefficient to adaptively scale the projection for each unlabeled sample according to its degree of alignment with the known subspace, thereby reducing subspace overlap without suppressing unlabeled samples that likely belong to known classes. Experiments show that EAGC consistently boosts existing methods and establishes new state-of-the-art results. Code is available at https://haiyangzheng.github.io/EAGC.