论时序粒度在脉冲神经网络鲁棒性中的作用
On the Role of Temporal Granularity in the Robustness of Spiking Neural Networks
提出时序粒度攻击(TG-Attack)和时序敏感度(TSV)来评估脉冲神经网络在单个时间步的鲁棒性,并设计时序粒度正则化(TG-Reg)提升整体鲁棒性,为SNN的对抗鲁棒性分析提供了细粒度工具。
原文依据 we revisit SNN robustness through the lens of temporal granularity, emphasizing the distinct behaviors that occur at individual time steps.
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论作为第三代神经网络,脉冲神经网络(SNN)凭借其独特的时序动力学,在多种应用中展现出显著潜力。近年来,从时序角度分析SNN的鲁棒性已成为一个新兴的研究焦点。然而,现有工作大多仅考察SNN的整体时序行为,通常采用基于时间平均梯度的对抗攻击。本研究通过时序粒度的视角重新审视SNN的鲁棒性,强调在单个时间步上出现的不同行为。我们首先引入时序粒度攻击(TG-Attack),它选择性地扰动特定时间步的梯度。该方法能够对SNN跨时间的鲁棒性进行更细粒度的评估,并展现出比传统梯度平均方法更高的攻击成功率。此外,我们从理论上证明,SNN在给定时间步的鲁棒性由该步输入-输出梯度的Hessian矩阵决定,我们将其定义为时序敏感度(TS)。通过计算每个时间步的时序敏感度值(TSV),无需生成对抗样本即可有效估计鲁棒性。最后,我们提出时序粒度正则化(TG-Reg)项,约束所有时间步上的TSV,从而提升模型的整体鲁棒性。实验评估证实,我们的框架持续优于现有最优方法。
英文原文摘要 1540 字符
As the third generation of neural networks, Spiking Neural Networks (SNNs) have demonstrated remarkable potential across diverse applications owing to their unique temporal dynamics. In recent years, analyzing the robustness of SNNs from a temporal perspective has become an emerging research focus. However, most existing works examine only the overall temporal behavior of SNNs, typically applying adversarial attacks that rely on time-averaged gradients. In this study, we revisit SNN robustness through the lens of temporal granularity, emphasizing the distinct behaviors that occur at individual time steps. We first introduce a Temporal Granularity Attack (TG-Attack), which selectively perturbs gradients at specific time steps. This approach enables a finer-grained evaluation of SNN robustness across time and demonstrates higher attack success rates than traditional gradient-averaging methods. Furthermore, we theoretically show that the robustness of SNNs at a given time step is determined by the Hessian of the input-output gradient at that step, which we define as Temporal Sensitivity (TS). By calculating the Temporal Sensitivity Value (TSV) for each time step, robustness can be effectively estimated without generating adversarial examples. Finally, we propose a Temporal Granularity Regularization (TG-Reg) term that constrains the TSV across all time steps, thereby improving the model's overall robustness. Experimental evaluations confirm that our framework consistently outperforms existing state-of-the-art methods.