FedCART:通过分类器精修应对联邦对抗训练中的长尾分布
FedCART: Tackling Long-Tailed Distributions in Federated Adversarial Training via Classifier Refinement
把模型解耦为共享特征提取器与双分类器,并用梯度类原型在服务端合成平衡虚拟特征重训辅助分类器,这一套「原型校准 + 虚拟特征重平衡」思路可直接迁移到视觉中的长尾分类与对抗鲁棒性联合优化场景。
原文依据 we propose FedCART, a novel FAT framework that decouples the model into a shared feature extractor and a dual-classifier structure
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论现实世界中日益增长的隐私与安全需求激发了对具备对抗鲁棒性的联邦学习(FL)的研究兴趣。对抗训练(AT)在集中式学习中是一种成熟的防御手段,但将其扩展到联邦场景(即联邦对抗训练,FAT)时,由于客户端之间的数据异构性而面临重大挑战。现有 FAT 方法已做出重要贡献,但它们通常假设全局数据分布是平衡的,而由于长尾分布的普遍存在,这一假设在现实中很少成立。本文首次识别并诊断了 FAT 在长尾数据下的严重性能退化,并将其归因于特征表示偏斜与分类器判别能力受损。为解决该问题,我们提出 FedCART,一种新的 FAT 框架,将模型解耦为共享特征提取器与双分类器结构。在客户端,表示对齐损失增强了对抗鲁棒性,同时提取基于梯度的类原型用于分类器校准。在服务端,对模型与原型集合进行聚合以合成平衡的虚拟特征,从而能够重新训练一个辅助分类器以缓解长尾偏置。大量实验表明,FedCART 显著提升了准确率与鲁棒性,优于最优的 FAT 方法。据我们所知,这是首个系统性地研究与解决长尾分布下 FAT 问题的工作,是迈向联邦学习中实用对抗鲁棒性的重要一步。
英文原文摘要 1643 字符
Growing privacy and security demands in the real world have spurred interest in adversarially robust Federated Learning (FL). While Adversarial Training (AT) is a well-established defense in centralized learning, its extension to the federated setting, known as Federated Adversarial Training (FAT), faces significant challenges due to data heterogeneity across clients. Existing FAT methods have made significant contributions, but they typically assume a balanced global data distribution, an assumption that rarely holds true in practice due to the prevalence of long-tailed distributions. This work first identifies and diagnoses the severe performance degradation of FAT under long-tailed data, attributing it to skewed feature representations and impaired classifier discriminability. To address this, we propose FedCART, a novel FAT framework that decouples the model into a shared feature extractor and a dual-classifier structure. On the client side, a representation-alignment loss enhances adversarial robustness, while gradient-based class prototypes are extracted for classifier calibration. On the server side, models and prototype sets are aggregated to synthesize balanced virtual features, enabling the re-training of an auxiliary classifier to mitigate long-tailed bias. Extensive experiments demonstrate that FedCART significantly improves both accuracy and robustness, outperforming state-of-the-art FAT methods. To the best of our knowledge, this is the first work to systematically investigate and address FAT under long-tailed distributions, representing a significant step toward practical adversarial robustness in FL.