生成模型与扩散 · CVPR2026 ·2026.06.03

One-to-All Animation:免对齐的角色动画与图像姿态迁移

One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfer

Shijun Shi、Jing Xu、Zhihang Li、Chunli Peng、Xiaoda Yang、Lijing Lu 等 8 人

与你有关的部分

把参考图与目标姿态的空间错位问题重构成自监督外绘任务,并用混合参考融合注意力处理变分辨率与动态序列长度,这套思路可直接迁移到任意参考布局下的可控视频生成与身份保持任务。

原文依据 we reformulate training as a self-supervised outpainting task that transforms diverse-layout reference into a unified occluded-input format
可迁移到 pose-driven character animationimage pose transfercontrollable video generationimage outpainting

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

近期扩散模型的进展大幅提升了姿态驱动的角色动画。然而,现有方法局限于空间对齐且骨骼结构匹配的参考-姿态对,参考与姿态之间的错位问题仍未得到解决。为此,我们提出 One-to-All Animation,一个面向任意布局参考的高保真角色动画与图像姿态迁移的统一框架。首先,为处理空间上错位的参考,我们将训练重构为自监督外绘任务,把布局各异的参考转换为统一的遮挡输入格式。其次,为处理部分可见的参考,我们设计了参考提取器以全面提取身份特征。进一步,我们引入混合参考融合注意力以应对变化的分辨率与动态序列长度。最后,从生成质量的角度,我们提出身份鲁棒的姿态控制,将外观与骨骼结构解耦以缓解姿态过拟合,并提出词元替换策略以实现连贯的长视频生成。大量实验表明,我们的方法优于现有方法。代码与模型已发布于 https://github.com/ssj9596/One-to-All-Animation。

英文原文摘要 1264 字符

Recent advances in diffusion models have greatly improved pose-driven character animation. However, existing methods are limited to spatially aligned reference-pose pairs with matched skeletal structures. Handling reference-pose misalignment remains unsolved. To address this, we present One-to-All Animation, a unified framework for high-fidelity character animation and image pose transfer for references with arbitrary layouts. First, to handle spatially misaligned reference, we reformulate training as a self-supervised outpainting task that transforms diverse-layout reference into a unified occluded-input format. Second, to process partially visible reference, we design a reference extractor for comprehensive identity feature extraction. Further, we integrate hybrid reference fusion attention to handle varying resolutions and dynamic sequence lengths. Finally, from the perspective of generation quality, we introduce identity-robust pose control that decouples appearance from skeletal structure to mitigate pose overfitting, and a token replace strategy for coherent long-video generation. Extensive experiments show that our method outperforms existing approaches. The code and model are available at https://github.com/ssj9596/One-to-All-Animation.

标签

会议 CVPR2026
页码 4011-4021
Bibkey
来源 CVF Open Access