Vanast：通过合成三元组监督实现结合人体动画的虚拟试衣
Vanast: Virtual Try-On with Human Image Animation via Synthetic Triplet Supervision
将图像虚拟试衣与姿态驱动人体动画合并为单步统一生成，并用合成三元组监督（人物-服装-姿态视频）训练视频扩散 Transformer；其数据构造管线与 Dual Module 架构可直接迁移到需要身份保持的可控视频生成任务。
原文依据 We present Vanast, a unified framework that generates garment-transferred human animation videos directly from a single human image, garment images, and a pose guidance video.
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论我们提出 Vanast，一个统一框架，可直接从单张人物图像、服装图像和姿态引导视频生成换装后的人体动画视频。传统的两阶段流程将基于图像的虚拟试衣与姿态驱动动画视为彼此分离的过程，这往往导致身份漂移、服装形变以及前后不一致。我们的模型通过在一个统一的单步过程中完成整个流程来实现连贯合成，从而解决这些问题。为支持这一设定，我们构建了大规模三元组监督数据。我们的数据生成管线包括：生成穿着与服装目录图不同服饰且保持身份一致的人物图像；采集完整的上装与下装三元组，以克服仅有单件服装-姿态视频对的限制；以及在不依赖服装目录图的情况下组装多样化的真实场景三元组。我们进一步为视频扩散 Transformer 引入双模块架构，以稳定训练、保持预训练生成质量，并提升服装准确性、姿态遵循度和身份保持能力，同时支持零样本服装插值。综合这些贡献，Vanast 能够在多种服装类型上生成高保真、身份一致的动画。
英文原文摘要 1314 字符
We present Vanast, a unified framework that generates garment-transferred human animation videos directly from a single human image, garment images, and a pose guidance video. Conventional two-stage pipelines treat image-based virtual try-on and pose-driven animation as separate processes, which often results in identity drift, garment distortion, and front-back inconsistency. Our model addresses these issues by performing the entire process in a single unified step to achieve coherent synthesis. To enable this setting, we construct large-scale triplet supervision. Our data generation pipeline includes generating identity-preserving human images in alternative outfits that differ from garment catalog images, capturing full upper and lower garment triplets to overcome the single-garment-posed video pair limitation, and assembling diverse in-the-wild triplets without requiring garment catalog images. We further introduce a Dual Module architecture for video diffusion transformers to stabilize training, preserve pretrained generative quality, and improve garment accuracy, pose adherence, and identity preservation while supporting zero-shot garment interpolation. Together, these contributions allow Vanast to produce high-fidelity, identity-consistent animation across a wide range of garment types.