自监督与表征学习 · CVPR2026 ·2026.06.03

时序表征增强(TRE):学习遗忘主导模式以增强时序脉冲特征

Temporal Representation Enhancement (TRE): Learning to Forget Dominant Patterns for Enhanced Temporal Spiking Features

Wei Liu、Li Yang、Yufei Wang、Han Xiao、Boyu Cai、Weiming Hu

与你有关的部分

对训练多时间步脉冲网络的人有用:用类特定贡献估计加时序累积找出主导语义模式并动态抑制,把监督从「时间不变」改成「时间互补」,可直接套到任意 SNN 骨干上提升时序判别力与特征多样性。

原文依据 Temporal Representation Enhancement(TRE), a novel learning-to-forget paradigm that encourages more diverse and complementary temporal representations
可迁移到 图像分类神经形态视觉识别时序特征学习

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

脉冲神经网络(SNN)天然在多个时间步上处理视觉输入,具有丰富的时序动态与高能效计算能力。然而,训练中常用的时间不变监督往往会强化各时间步上相同的主导响应模式,导致表征冗余并限制时序判别性。为克服这一局限,我们提出时序表征增强(TRE),一种新的「学习遗忘」范式,鼓励更加多样且互补的时序表征。TRE 通过类特定贡献估计与时序累积识别高贡献语义模式,并采用动态调制策略对其进行选择性抑制。通过将模型注意力重新导向其他仍有信息量的语义线索,TRE 促进跨时间步的互补特征学习。该方法不仅增强了 SNN 的时序判别能力,还通过利用更丰富的语义信息实现更有效的多时间步学习。在静态图像数据集与动态神经形态数据集上的大量实验表明,TRE 在不同 SNN 骨干上均能持续提升分类准确率与特征多样性。

英文原文摘要 1307 字符

Spiking Neural Networks (SNNs) naturally process visual inputs across multiple timesteps, offering rich temporal dynamics and energy-efficient computation. However, the temporally invariant supervision commonly used in training tends to reinforce the same dominant response patterns across timesteps, leading to redundant representations and limiting temporal discriminability. To overcome this limitation, we introduce Temporal Representation Enhancement(TRE), a novel learning-to-forget paradigm that encourages more diverse and complementary temporal representations. TRE identifies high-contribution semantic patterns through class-specific contribution estimation and temporal accumulation, and selectively suppresses them using a dynamic modulation strategy. By redirecting the model's attention toward alternative yet informative semantic cues, TRE promotes the learning of complementary features across timesteps. This approach not only strengthens the temporal discriminative capacity of SNNs but also enables more effective multi-timestep learning by leveraging richer semantic information. Extensive experiments on both static image datasets and dynamic neuromorphic datasets demonstrate that TRE consistently improves classification accuracy and feature diversity across different SNN backbones.

标签

会议 CVPR2026
页码 34480-34490
Bibkey
来源 CVF Open Access