底层视觉与图像复原 · CVPR2026 ·2026.06.03

基于事件的高质量高效湍流抑制

High-Quality and Efficient Turbulence Mitigation with Events

Xiaoran Zhang、Jian Ding、Yuxing Duan、Haoyue Liu、Gang Chen、Yi Chang 等 7 人

与你有关的部分

把事件相机的微秒级时序信息当作运动与结构先验,用极性加权梯度做场景细化、用事件管(event tube)约束把动态物体从湍流扰动中解耦,从而在极少帧下完成复原;这套「事件先验 + 少帧复原」思路可直接迁移到低光照、去模糊、视频稳定等时序退化复原任务。

原文依据 dynamic objects form spatiotemporally coherent "event tubes" in contrast to irregular patterns within turbulent events
可迁移到 图像复原事件相机视觉视频去湍流多帧融合

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

由于大气湍流的随机性,湍流抑制(TM)是一个高度病态的问题。大多数方法依赖传统相机记录的多帧图像来捕捉自然场景中的稳定模式。然而,这些方法不可避免地面临精度与效率之间的权衡:更多帧可以提升复原效果,但代价是更高的系统延迟和更大的数据开销。事件相机具备微秒级时序分辨率并能高效感知动态变化,为突破这一瓶颈提供了机会。本文提出 EHETM,一种受事件在连续序列中建模运动之优势启发的高质量、高效湍流抑制方法。我们发现两个关键现象:(1)湍流引起的事件呈现出与图像锐利梯度相关的明显极性交替,为恢复场景提供结构线索;(2)动态物体形成时空连贯的「事件管」,与湍流事件中的不规则模式形成对比,为将物体从湍流中解耦提供运动先验。基于这些发现,我们设计了两个互补模块,分别利用极性加权梯度进行场景细化、利用事件管约束进行运动解耦,从而在少帧条件下实现高质量复原。此外,我们构建了两个真实世界的事件-帧湍流数据集,涵盖大气湍流与热湍流情形。大量实验表明,EHETM 优于当前最先进方法,尤其在含动态物体的场景中,同时将数据开销和系统延迟分别降低约 77.3% 和 89.5%。

英文原文摘要 1637 字符

Turbulence mitigation (TM) is highly ill-posed due to the stochastic nature of atmospheric turbulence. Most methods rely on multiple frames recorded by conventional cameras to capture stable patterns in natural scenarios. However, they inevitably suffer from a trade-off between accuracy and efficiency: more frames enhance restoration at the cost of higher system latency and larger data overhead. Event cameras, equipped with microsecond temporal resolution and efficient sensing of dynamic changes, offer an opportunity to break the bottleneck. In this work, we present EHETM, a high-quality and efficient TM method inspired by the superiority of events to model motions in continuous sequences. We discover two key phenomena: (1) turbulence-induced events exhibit distinct polarity alternation correlated with sharp image gradients, providing structural cues for restoring scenes; and (2) dynamic objects form spatiotemporally coherent "event tubes" in contrast to irregular patterns within turbulent events, providing motion priors for disentangling objects from turbulence. Based on these insights, we design two complementary modules that respectively leverage polarity-weighted gradients for scene refinement and event-tube constraints for motion decoupling, achieving high-quality restoration with few frames. Furthermore, we construct two real-world event-frame turbulence datasets covering atmospheric and thermal cases. Extensive experiments show that EHETM outperforms SOTA methods, especially under scenes with dynamic objects, while reducing data overhead and system latency by approximately 77.3% and 89.5%, respectively.

标签

会议 CVPR2026
页码 29514-29525
Bibkey
来源 CVF Open Access