高效模型与推理加速 · CVPR2026 ·2026.06.03

梯度知道最优:基于梯度引导位分配的混合精度量化用于超分辨率

Gradient Knows Best: Mixed-Precision Quantization via Gradient-Guided Bit Allocation for Super-Resolution

Jun Young Kim、Joo Hyeon Jeon、Sangyeon Ahn、Yoonseo Park、Yong Seok Oh、Bogyeong Kim 等 7 人

与你有关的部分

提出基于梯度的量化敏感度估计和动态激活范围归一化,可直接用于超分辨率模型的混合精度量化,在保持重建质量的同时降低计算和内存开销。

原文依据 we propose a novel PTQ-based MPQ framework tailored for SR models
可迁移到 图像超分辨率模型量化

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

尽管基于深度学习的图像超分辨率(SR)模型在重建质量上取得了显著进展,但其高计算和内存需求使其不适合轻量级平台。为了解决这个问题,各种量化技术被引入。其中,混合精度量化(MPQ)引入逐层位宽分配,以平衡计算效率与重建质量。然而,现有的基于训练后量化(PTQ)的SR模型MPQ方法面临两个关键限制。首先,使用静态统计的量化敏感度估计无法捕捉每层引起的准确量化误差,导致次优的位分配。其次,移除批归一化(BN)以保留高频细节会导致激活间的尺度不一致,使得固定量化范围不足以准确表示其分布。因此,我们提出了一种新颖的基于PTQ的MPQ框架,专为SR模型定制。我们的方法通过利用目标函数对位宽的梯度来估计权重和激活的量化敏感度,从而实现自适应逐层位分配和快速收敛。此外,我们引入了动态激活范围归一化,缓解了因缺少BN而导致的分布不平衡,确保在固定范围约束下的稳定量化。我们的方法在Urban100数据集上以峰值信噪比(PSNR)比现有基于PTQ的方法高出1.26 dB,并将EDSR x4的3位量化的量化时间减少了1.9倍。

英文原文摘要 1660 字符

Although deep learning-based image super-resolution (SR) models have achieved remarkable progress in reconstruction quality, their high computational and memory demands make them unsuitable for lightweight platforms. To address this issue, various quantization techniques have been introduced. Among them, mixed-precision quantization (MPQ) introduces a layer-wise bit-width allocation to balance computational efficiency with reconstruction quality. However, existing MPQ methods based on post-training quantization (PTQ) for SR models face two critical limitations. First, quantization sensitivity estimation using static statistics fails to capture the accurate quantization error induced by each layer, resulting in suboptimal bit allocation. Second, removing batch normalization (BN) to preserve high-frequency details leads to scale inconsistencies across activations, making fixed quantization ranges insufficient to accurately represent their distribution. Therefore, we propose a novel PTQ-based MPQ framework tailored for SR models. Our method estimates the quantization sensitivity of weights and activations by leveraging gradients of the objective function with respect to bit-widths, enabling adaptive layer-wise bit allocation and fast convergence. Additionally, we introduce a dynamic activation range normalization that alleviates the distributional imbalance caused by the absence of BN, ensuring stable quantization under fixed range constraints. Our method outperforms existing PTQ-based methods by 1.26 dB in peak signal-to-noise ratio (PSNR) on the Urban100 dataset and reduces quantization time by x1.9 for 3-bit quantization of EDSR x4.

标签

会议 CVPR2026
页码 16355-16364
Bibkey
来源 CVF Open Access