域偏斜联邦学习中的特征解耦与校准
Domain-Skewed Federated Learning with Feature Decoupling and Calibration
把特征单元按域鲁棒性拆成域鲁棒/域相关两部分再校准,这套「解耦+校准」思路可直接迁移到视觉里的跨域表征学习与测试时域适应,用来防止表征坍缩到低维子空间。
原文依据 separating the local features into domain-robust features and domain-related features
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论联邦学习(FL)使分布式客户端能够在保护隐私的前提下协作训练一个全局模型。然而,一个主要挑战是域偏斜:来自不同域的客户端数据可能阻碍聚合后的全局模型学习到一致的表示空间,导致其在多个域上的泛化能力较差。本文认为,域偏斜体现在每个客户端的域特定偏置特征中,使本地模型的表示坍缩到一个狭窄的低维子空间。为此,我们提出联邦特征解耦与校准(F^2DC),通过校准域特定偏置特征来释放有价值的类相关信息,从而实现跨域更一致的表示。F^2DC 首先引入一个新组件——域特征解耦器(DFD),用于判定每个特征单元的鲁棒性,从而将本地特征分离为域鲁棒特征与域相关特征。随后提出域特征校正器(DFC),通过显式关联判别性信号来校准这些域相关特征,捕获可补充域鲁棒特征的额外类相关线索。最后,对本地模型执行域感知聚合,以促进客户端之间的一致性。在三个常用多域数据集上的实验结果验证了所提 F^2DC 的有效性及其两个模块的贡献。
英文原文摘要 1520 字符
Federated learning (FL) allows distributed clients to collaboratively train a global model in a privacy-preserving manner. However, one major challenge is domain skew, where clients' data originating from diverse domains may hinder the aggregated global model from learning a consistent representation space, resulting in poor generalizable ability in multiple domains. In this paper, we argue that the domain skew is reflected in the domain-specific biased features of each client, causing the local model's representations to collapse into a narrow low-dimensional subspace. We then propose Federated Feature Decoupling and Calibration (**F^2DC**), which liberates valuable class-relevant information by calibrating the domain-specific biased features, enabling more consistent representations across domains. A novel component, Domain Feature Decoupler (DFD), is first introduced in F^2DC to determine the robustness of each feature unit, thereby separating the local features into domain-robust features and domain-related features. A Domain Feature Corrector (DFC) is further proposed to calibrate these domain-related features by explicitly linking discriminative signals, capturing additional class-relevant clues that complement the domain-robust features. Finally, a domain-aware aggregation of the local models is performed to promote consensus among clients. Empirical results on three popular multi-domain datasets demonstrate the effectiveness of the proposed F^2DC and the contributions of its two modules.