生成模型与扩散 · CVPR2026 ·2026.06.03

面向自回归动作生成的因果动作扩散模型

Causal Motion Diffusion Models for Autoregressive Motion Generation

Qing Yu、Akihisa Watanabe、Kent Fujiwara

与你有关的部分

把因果扩散强制(causal diffusion forcing)与逐帧采样调度引入潜空间扩散 Transformer,为视觉领域实现流式、低延迟的自回归序列生成(如视频、动作序列)提供了可复用的时序因果去噪范式。

原文依据 an autoregressive diffusion transformer is trained using causal diffusion forcing to perform temporally ordered denoising across motion frames
可迁移到 text-to-motion generationstreaming motion synthesislong-horizon motion generation

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

近期动作扩散模型的进展显著提升了人体动作合成的真实感。然而,现有方法分为两类:一类是双向生成的全序列扩散模型,限制了时序因果性与实时适用性;另一类是自回归模型,易受不稳定性和误差累积的影响。本文提出因果动作扩散模型(CMDM),这是一个基于因果扩散 Transformer、在语义对齐的潜空间中运行的自回归动作生成统一框架。CMDM 建立在动作-语言对齐因果变分自编码器(MAC-VAE)之上,该变分自编码器将动作序列编码为时序因果的潜变量表示。在此潜变量表示之上,训练一个自回归扩散 Transformer,利用因果扩散强制在动作帧之间执行时序有序的去噪。为实现快速推理,我们引入带有因果不确定性的逐帧采样调度,其中每一后续帧由部分去噪的前序帧预测得到。由此得到的框架支持高质量的文本到动作生成、流式合成以及交互速率下的长时程动作生成。在 HumanML3D 和 SnapMoGen 上的实验表明,CMDM 在语义保真度和时序平滑度上均优于现有的扩散模型与自回归模型,同时大幅降低推理延迟。

英文原文摘要 1459 字符

Recent advances in motion diffusion models have substantially improved the realism of human motion synthesis. However, existing approaches fall into two categories: full-sequence diffusion models with bidirectional generation, which limit temporal causality and real-time applicability, and autoregressive models, which are vulnerable to instability and error accumulation. In this work, we present Causal Motion Diffusion Models (CMDM), a unified framework for autoregressive motion generation based on a causal diffusion transformer that operates in a semantically aligned latent space. CMDM builds upon a Motion-Language-Aligned Causal VAE (MAC-VAE), which encodes motion sequences into temporally causal latent representations. On top of this latent representation, an autoregressive diffusion transformer is trained using causal diffusion forcing to perform temporally ordered denoising across motion frames. To achieve fast inference, we introduce a frame-wise sampling schedule with causal uncertainty, where each subsequent frame is predicted from partially denoised previous frames. The resulting framework supports high-quality text-to-motion generation, streaming synthesis, and long-horizon motion generation at interactive rates. Experiments on HumanML3D and SnapMoGen demonstrate that CMDM outperforms existing diffusion and autoregressive models in both semantic fidelity and temporal smoothness, while substantially reducing inference latency.

标签

会议 CVPR2026
页码 38366-38375
Bibkey
来源 CVF Open Access