Mobile-VTON:高保真端侧虚拟试衣
Mobile-VTON: High-Fidelity On-Device Virtual Try-On
论文提出的 Feature-Guided Adversarial 蒸馏策略与潜变量拼接式轻量跨模态条件注入,为在移动端部署扩散类生成模型提供了可复用的压缩与条件控制方案;做端侧图像生成或可控生成的研究者可借鉴其教师-学生蒸馏与轨迹一致性损失的设计。
原文依据 a Feature-Guided Adversarial (FGA) Distillation strategy that combines teacher supervision with adversarial learning
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论虚拟试衣(VTON)近期在视觉保真度上取得了令人瞩目的进展,但现有系统大多需要将个人照片上传至云端 GPU,这既引发隐私顾虑,也限制了端侧部署。为解决这一问题,我们提出 Mobile-VTON,一个高质量、保护隐私的框架,仅需单张用户图像与服装图像,即可在普通移动设备上实现完全离线的虚拟试衣。Mobile-VTON 引入模块化的 TeacherNet--GarmentNet--TryonNet(TGT)架构,将知识蒸馏、以服装为条件的生成以及服装对齐整合为一条面向端侧效率优化的统一流水线。在该框架内,我们提出特征引导对抗(FGA)蒸馏策略,将教师监督与对抗学习相结合,以更好地匹配真实图像分布。GarmentNet 采用轨迹一致性损失训练,以在扩散步之间保持服装语义;TryonNet 则使用潜变量拼接与轻量跨模态条件控制,在无需大规模预训练的情况下实现稳健的服装到人体对齐。通过组合这些组件,Mobile-VTON 以较低的计算开销实现高保真生成。在 1024 x 768 分辨率下的 VITON-HD 与 DressCode 数据集上的实验表明,它在完全离线运行的同时,达到或超越了强力的服务器端基线。这些结果说明,高质量 VTON 不仅在端侧可行,而且具有实用性,为真实应用提供了一种安全的解决方案。
英文原文摘要 1545 字符
Virtual try-on (VTON) has recently achieved impressive visual fidelity, but most existing systems require uploading personal photos to cloud-based GPUs, raising privacy concerns and limiting on-device deployment. To address this, we present Mobile-VTON, a high-quality, privacy-preserving framework that enables fully offline virtual try-on on commodity mobile devices using only a single user image and a garment image. Mobile-VTON introduces a modular TeacherNet--GarmentNet--TryonNet (TGT) architecture that integrates knowledge distillation, garment-conditioned generation, and garment alignment into a unified pipeline optimized for on-device efficiency. Within this framework, we propose a Feature-Guided Adversarial (FGA) Distillation strategy that combines teacher supervision with adversarial learning to better match real-world image distributions. GarmentNet is trained with a trajectory-consistency loss to preserve garment semantics across diffusion steps, while TryonNet uses latent concatenation and lightweight cross-modal conditioning to enable robust garment-to-person alignment without large-scale pretraining. By combining these components, Mobile-VTON achieves high-fidelity generation with low computational overhead. Experiments on VITON-HD and DressCode at 1024 x 768 show that it matches or outperforms strong server-based baselines while running entirely offline. These results demonstrate that high-quality VTON is not only feasible but also practical on-device, offering a secure solution for real-world applications.