生成模型与扩散 · CVPR2026 ·2026.06.03

基于整流流 Transformer 的概率性降水临近预报

Probabilistic Precipitation Nowcasting with Rectified Flow Transformers

Johannes Schusterbauer、Jannik Wiese、Nick Stracke、Timy Phan、Björn Ommer

与你有关的部分

把 rectified flow transformer 用在潜空间视频预测上,并用逐帧编码器加统一解码器保证时序一致性;这套「保留不确定性的第一阶段压缩 + 潜空间流匹配生成」可以直接迁移到视频预测、时空序列生成等视觉任务,测试时扩展带来的增益也值得在视觉生成里复现验证。

原文依据 a FRame-wise Encoder and United Decoder model based on rectified flow transformers for efficient compression of spatio-temporal weather data
可迁移到 视频预测时空序列生成概率生成建模

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

准确的天气预报在多个领域都至关重要,在极端天气条件下更是关乎安全。与基于模拟的预报相比,数据驱动方法效率更高,能够实现短期、高分辨率的临近预报。特别是扩散模型凭借其强大的概率基础,在天气临近预报中被证明是有效的。然而,现有方法依赖确定性压缩来降低高维天气数据的复杂度,限制了其在解码过程中捕捉不确定性的能力。在本工作中,我们提出 FREUD,一种基于整流流 Transformer 的逐帧编码器与统一解码器模型,用于对时空天气数据进行高效压缩。逐帧编码支持持续的预报更新,而统一的视频解码器保证了时序一致性。我们保留不确定性的第一阶段使我们能够通过集合来捕捉偶然不确定性,这对于解码变异性较高的极端天气事件尤为有益。我们在 SEVIR 基准上使用紧凑的潜空间整流流 Transformer 在降水临近预报中取得了最优性能,并展示了通过模型扩展与测试时扩展带来的进一步性能提升。

英文原文摘要 1266 字符

Accurate weather forecasts are essential across various domains and are safety-critical in extreme weather conditions. Compared to simulation-based forecasting, data-driven approaches show greater efficiency, enabling short-term, high-resolution nowcasting. In particular, diffusion models proved effective in weather nowcasting due to their strong probabilistic foundation. However, existing methods rely on deterministic compression to reduce the complexity of high-dimensional weather data, limiting their ability to capture uncertainty in the decoding process. In this work, we introduce FREUD, a FRame-wise Encoder and United Decoder model based on rectified flow transformers for efficient compression of spatio-temporal weather data. Frame-wise encoding enables continuous forecast updates, while the unified video decoder ensures temporal consistency. Our uncertainty-preserving first stage allows us to capture aleatoric uncertainty through ensembling, which is particularly beneficial for extreme weather events with high decoding variability. We achieve state-of-the-art performance in precipitation nowcasting with a compact latent-space rectified flow transformer on the SEVIR benchmark and show further performance gains by model and test-time scaling.

标签

会议 CVPR2026
页码 25742-25756
Bibkey
来源 CVF Open Access