基于单步扩散与语义时序引导的视频编码
Single-step Diffusion-based Video Coding with Semantic-Temporal Guidance
将单步扩散生成器与条件编码框架结合，利用缓冲特征提取帧自适应语义引导替代文本条件，并通过时序一致性引导增强帧间连贯性，为低码率视频压缩提供高效高感知质量的方案。
原文依据 we propose S2VC, a Single Step diffusion-based Video Codec that integrates a conditional coding framework with an efficient single-step diffusion generator
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论传统与神经视频编解码器（NVC）虽已取得显著的率失真性能，但在低码率下提升感知质量仍具挑战。部分NVC引入感知或对抗目标，却因生成能力有限而残留伪影；另一些则利用预训练扩散模型提升质量，但采样复杂度高。为克服这些挑战，我们提出S2VC，一种单步扩散视频编解码器，将条件编码框架与高效单步扩散生成器相结合，在低码率下实现真实感重建并降低采样成本。鉴于语义条件在单步扩散中的重要性，我们引入上下文语义引导，从缓冲特征中提取帧自适应语义。该引导以高效细粒度条件替代文本描述，从而提升生成真实感。此外，时序一致性引导被融入扩散U-Net，以增强帧间时序连贯性并确保稳定生成。大量实验表明，S2VC在感知质量上达到最优，相较先前感知方法平均节省51.62%码率，彰显了单步扩散在高效高质量视频压缩中的前景。项目：https://onedc-codec.github.io/s2vc/
英文原文摘要 1423 字符
While traditional and neural video codecs (NVCs) have achieved remarkable rate-distortion performance, improving perceptual quality at low bitrates remains challenging. Some NVCs incorporate perceptual or adversarial objectives but still suffer from artifacts due to limited generation capacity, whereas others leverage pretrained diffusion models to improve quality at the cost of high sampling complexity. To overcome these challenges, we propose S2VC, a Single Step diffusion-based Video Codec that integrates a conditional coding framework with an efficient single-step diffusion generator, enabling realistic reconstruction at low bitrates with reduced sampling cost. Recognizing the importance of semantic conditioning in single-step diffusion, we introduce Contextual Semantic Guidance to extract frame-adaptive semantics from buffered features. This guidance replaces text captions with efficient, fine-grained conditioning, thereby improving generation realism. In addition, Temporal Consistency Guidance is incorporated into the diffusion U-Net to enforce temporal coherence across frames and ensure stable generation. Extensive experiments show that S2VC delivers state-of-the-art perceptual quality with an average bitrate saving of 51.62% over prior perceptual method, underscoring the promise of single-step diffusion for efficient, high-quality video compression. Project: https://onedc-codec.github.io/s2vc/