基于稀疏注意力与自适应频率的学习图像压缩
Learned Image Compression via Sparse Attention and Adaptive Frequency
跨稀疏窗口注意力用少量窗口条件化的全局 token 建模长程依赖,在计算量低于标准窗口自注意力的同时提升效果,可直接迁移到其他需要高效全局建模的视觉骨干;内容自适应频率变换与仅训练期去噪正则化也为潜变量结构化和零推理开销的质量提升提供了可复用思路。
原文依据 we introduce Cross-Sparse Window Attention, leveraging sparse, window-conditioned global tokens to efficiently model long-range dependencies
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论学习图像压缩(LIC)方法在率失真(RD)性能上超越了传统算法,但仍难以在有效性与效率之间取得最优平衡。此外,尽管近期研究已证明利用频域信息的有效性,但这些方法通常依赖固定的频率变换,仍缺乏内容自适应能力。因此,我们提出一种具有更强自适应性与效率的先进空频双路径 LIC 方法。具体而言,在空间路径上,我们引入跨稀疏窗口注意力,利用稀疏的、以窗口为条件的全局 token 高效建模长程依赖。相比标准的基于窗口的多头自注意力,它实现了更低的计算成本和更优的有效性。在频率路径上,我们设计了一种内容自适应频率变换,采用分解权重生成器和可学习的全局权重来自适应地处理多尺度频率分量。此外,我们提出去噪即正则化器,这是一个仅在训练阶段使用的模块,通过去噪任务对潜变量表示进行结构化与平滑处理,在零推理开销的情况下提升重建质量。在 Kodak、CLIC 和 Tecnick 数据集上的实验表明,所提方法在 RD 性能和延迟两方面均显著优于现有的最优方法。
英文原文摘要 1390 字符
Learned image compression (LIC) methods surpass traditional algorithms in rate-distortion (RD) performance, but still struggle to optimally balance effectiveness and efficiency. Moreover, although recent studies have demonstrated the effectiveness of utilizing frequency-domain information, they typically rely on fixed frequency transforms and still lack content-adaptive capabilities. Therefore, we propose an advanced spatial-frequency dual-path LIC method with enhanced adaptivity and efficiency. Specifically, for the spatial path, we introduce Cross-Sparse Window Attention, leveraging sparse, window-conditioned global tokens to efficiently model long-range dependencies. It achieves lower computational cost and superior effectiveness than standard Window-based Multi-head Self-attention. For the frequency path, we design a content-adaptive frequency transform, employing a decomposition weight generator and learnable global weights to adaptively process multi-scale frequency components. Furthermore, we propose Denoising-as-Regularizer, a training-only module that structures and smooths the latent representation via a denoising task, enhancing reconstruction quality at zero inference cost. Experiments on the Kodak, CLIC, and Tecnick datasets demonstrate that the proposed method significantly outperforms existing state-of-the-art methods in both RD performance and latency.