你的分类器能做更多:弥合分类、鲁棒性与生成之间的鸿沟
Your Classifier Can Do More: Towards Balancing the Gaps in Classification, Robustness, and Generation
把分类器本身当作能量模型,用 min-max 能量对齐把干净样本、对抗样本、生成样本的能量分布拉到一起,从而在同一个网络里同时拿到对抗鲁棒性、干净精度和生成能力;做鲁棒分类或想给判别模型加生成分支的工作可以直接复用这套能量对齐训练目标。
原文依据 we propose Energy-based Joint Distribution Adversarial Training (EB-JDAT), a unified generative-discriminative-robust framework
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论联合能量模型(JEM)以在单一框架内统一分类与生成而著称。尽管其生成与判别性能颇具前景,但其鲁棒性仍远逊于对抗训练(AT);后者相反,能获得强鲁棒性,却牺牲干净精度且缺乏生成能力。这一固有的三难困境——在分类精度、鲁棒性与生成能力之间取得平衡——引出一个根本性问题:单一模型能否同时实现这三者?为回答该问题,我们对多种 JEM 与 AT 变体中的干净样本、对抗样本与生成样本进行了系统的能量景观分析。我们观察到,AT 缩小了干净样本与对抗样本之间的能量差距,而 JEM 缩小了干净样本与合成样本之间的差距。这一观察引出一个关键洞见:若能对齐这三类数据的能量分布,就有可能弥合它们之间的性能差异。基于此思想,我们提出基于能量的联合分布对抗训练(EB-JDAT),一个统一的生成-判别-鲁棒框架,最大化干净分布与对抗分布的联合概率。EB-JDAT 引入一种新颖的 min-max 能量优化,以显式对齐干净样本、对抗样本与生成样本之间的能量。在 CIFAR-10、CIFAR-100 与 ImageNet 子集上的大量实验表明,EB-JDAT 在保持接近原始精度与 JEM 有竞争力的生成质量的同时,取得了最优的鲁棒性,有效在精度、鲁棒性与生成之间实现了新的权衡前沿。代码发布于 https://github.com/yujkc/EB-JDAT。
英文原文摘要 1727 字符
Joint Energy-based Models (JEMs) are well known for their ability to unify classification and generation within a single framework. Despite their promising generative and discriminative performance, their robustness remains far inferior to adversarial training (AT), which, conversely, achieves strong robustness but sacrifices clean accuracy and lacks generative ability. This inherent trilemma--balancing classification accuracy, robustness, and generative capability--raises a fundamental question: Can a single model achieve all three simultaneously? To answer this, we conduct a systematic energy landscape analysis of clean, adversarial, and generated samples across various JEM and AT variants. We observe that AT reduces the energy gap between clean and adversarial samples, while JEMs narrow the gap between clean and synthetic ones. This observation suggests a key insight: if the energy distributions of all three data types can be aligned, we might bridge their performance disparities. Building on this idea, we propose Energy-based Joint Distribution Adversarial Training (EB-JDAT), a unified generative-discriminative-robust framework that maximizes the joint probability of clean and adversarial distribution. EB-JDAT introduces a novel min-max energy optimization to explicitly aligning energies across clean, adversarial, and generated samples. Extensive experiments on CIFAR-10, CIFAR-100, and ImageNet subsets demonstrate that EB-JDAT achieves state-of-the-art robustness while maintaining near-original accuracy and competitive generation quality of JEMs, effectively achieving a new trade-off frontier between accuracy, robustness, and generation. The code is released at https://github.com/yujkc/EB-JDAT.