通过多级扩散统一精确关键帧与语义控制
Unifying Precise Keyframes and Semantic Control via Multi-level Diffusion
多级扩散框架把文本语义与关键帧隐式线索结合来调制全局运动动态、用单帧引导局部过渡，其推理阶段的轨迹细化+扩散插补策略可迁移到任何需要严格满足稀疏约束的生成任务（如视频插帧、轨迹可控生成）。
原文依据 we propose a multi-level diffusion framework that integrates textual semantics with implicit cues from keyframe sequences
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论文本条件的人体运动中间帧生成利用关键帧实现时空控制，文本则为过渡提供高层语义引导。然而，现有方法无法在文本语义与关键帧提供的时空约束之间建立连贯的对齐，往往导致运动约束不足并出现非预期行为。此外，它们难以实现精确的空间控制，常常生成偏离关键帧约束的运动。为解决这些问题，我们提出一个多级扩散框架，将文本语义与来自关键帧序列的隐式线索相结合以调制全局运动动态，同时利用单个关键帧引导其周围的局部过渡。在推理阶段，为确保严格遵循关键帧，我们提出一种新的轨迹细化策略，调整生成运动的根位置，随后通过扩散插补来细化所生成关键帧的姿态。此外，我们的框架支持保持语义的运动编辑，允许在保留原始运动语义的同时进行合理的修改。大量实验表明，我们的方法生成高质量运动，严格满足关键帧约束，同时实现精确的语义对齐。
英文原文摘要 1346 字符
Text-conditioned human motion in-betweening leverages keyframes for spatio-temporal control, with text providing high-level semantic guidance for the transitions. However, existing methods are unable to establish a coherent alignment between textual semantics and the spatio-temporal constraints provided by keyframes, often resulting in insufficiently constrained motions with unintended behavior. Moreover, they struggle with precise spatial control, often generating motions that deviate from keyframe constraints. To address these issues, we propose a multi-level diffusion framework that integrates textual semantics with implicit cues from keyframe sequences to modulate global motion dynamics, while leveraging individual keyframes to guide local transitions around them. During inference, to ensure strict keyframe adherence, we propose a novel trajectory refinement strategy that adjusts the root positions of the generated motion, followed by diffusion imputation to refine the poses of the generated keyframes. Additionally, our framework enables semantics-preserving motion editing, allowing for plausible modifications while retaining the original motion semantics. Extensive experiments demonstrate that our method generates high-quality motions that strictly satisfy keyframe constraints while achieving precise semantic alignment.