热扩散至关重要:基于热传导先验的红外时空视频超分辨率
Thermal Diffusion Matters: Infrared Spatial-Temporal Video Super-Resolution through Heat Conduction Priors
把热扩散/热传导方程当作视频超分中时序插帧与时空一致性的物理先验,并用频域扩散合成中间帧、用可学习谱滤波的选择性状态空间模型做时空精修,这套「物理方程约束 + 频域扩散 + SSM」的组合可迁移到其他低采样率视频复原任务。
原文依据 treats temporal feature sequences as one-dimensional heat fields and performs frequency-domain diffusion to synthesize temporally coherent intermediate frames
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论受热成像传感器的物理限制,红外视频采集本身存在空间分辨率低、帧率有限的问题。这些限制使红外视频增强面临独特挑战,因为它需要从高度欠采样的热信号中恢复空间细节与时序连续性。为应对这一挑战,本文提出 THERIS,一个受热物理启发的统一红外时空视频超分辨率框架。THERIS 以热扩散的物理原理为基础,利用支配红外像素强度时空演化的热传导动力学。具体而言,所提出的热扩散插值模块(TDIM)将时序特征序列视为一维热场,并执行频域扩散以合成时序连贯的中间帧。在此基础上,热感知状态空间模块(TSSM)通过可学习的谱滤波与选择性状态空间建模来精修时空表征,同时以继承自 TDIM 的热力学先验为引导保持一致性。此外,本文引入温度场建模损失,以约束结果遵循热传导方程,从而提升生成结果的时序连贯性与空间稳定性。大量实验表明,THERIS 取得了最优性能,并产生视觉上连贯的结果。为促进红外视频处理领域的进一步研究,本文还提出 IRVAL,一个包含 108,512 帧、分辨率为 512x512 的高分辨率数据集。
英文原文摘要 1653 字符
Infrared video acquisition inherently suffers from low spatial resolution and limited frame rates due to the physical constraints of thermal imaging sensors. These limitations make infrared video enhancement uniquely challenging, as it requires restoring spatial details and temporal continuity from highly undersampled thermal signals. To address this challenge, we propose THERIS, a unified THERmal-physics inspired framework for Infrared spatial-temporal video Super-resolution. Grounded in the physical principles of thermal diffusion, THERIS leverages heat conduction dynamics that govern the spatiotemporal evolution of infrared pixel intensities. Specifically, the proposed Thermal Diffusion Interpolation Module (TDIM) treats temporal feature sequences as one-dimensional heat fields and performs frequency-domain diffusion to synthesize temporally coherent intermediate frames. Building on this foundation, the Thermo-Aware State Space Module (TSSM) refines spatiotemporal representations through learnable spectral filtering and selective state-space modeling, while maintaining consistency guided by the thermodynamic prior inherited from TDIM. Additionally, a Temperature Field Modeling Loss is introduced to enforce adherence to the heat conduction equation, promoting temporal coherence and spatial stability in the generated results. Extensive experiments demonstrate that THERIS achieves state-of-the-art performance while producing visually coherent results. To facilitate further research in the infrared video processing domain, we also introduce IRVAL, a high-resolution dataset comprising 108,512 video frames at 512x512 resolution.