ObjectMorpher:基于可变形3D高斯泼溅的三维感知图像编辑
ObjectMorpher: 3D-Aware Image Editing via Deformable 3DGS
把图像到3D生成器产出的3DGS作为可编辑代理,用基于图的ARAP非刚性形变把2D拖拽点转化为几何一致的形变,再用复合扩散模块重合成光照与边界——这套「2D交互→3D形变→扩散调和」的管线可直接迁移到物体级编辑、姿态调整与重合成任务。
原文依据 a graph-based non-rigid deformation with as-rigid-as-possible (ARAP) constraints ensures physically sensible shape and pose changes
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论在图像编辑中实现精确的物体级控制仍具挑战:二维方法缺乏三维感知,常产生歧义或不合理的结果;而现有的三维感知方法依赖繁重的优化或不完整的单目重建。本文提出 ObjectMorpher,一个统一的交互式框架,将歧义的二维编辑转化为基于几何的操作。ObjectMorpher 借助图像到三维生成器将目标实例提升为可编辑的三维高斯泼溅(3DGS),从而实现快速且保持身份一致性的操控。用户拖拽控制点,基于图的非刚性形变在尽可能刚性(ARAP)约束下保证形状与姿态变化在物理上合理。一个复合扩散模块对光照、颜色与边界进行调和,以实现无缝重整合。在多种类别上,ObjectMorpher 均能给出细粒度、照片级真实的编辑结果,具备更优的可控性与效率,在 KID、LPIPS、SIFID 及用户偏好上优于二维拖拽与三维感知基线方法。
英文原文摘要 1025 字符
Achieving precise, object-level control in image editing remains challenging: 2D methods lack 3D awareness and often yield ambiguous or implausible results, while existing 3D-aware approaches rely on heavy optimization or incomplete monocular reconstructions. We present ObjectMorpher, a unified, interactive framework that converts ambiguous 2D edits into geometry-grounded operations. ObjectMorpher lifts target instances with an image-to-3D generator into editable 3D Gaussian Splatting (3DGS), enabling fast, identity-preserving manipulation. Users drag control points; a graph-based non-rigid deformation with as-rigid-as-possible (ARAP) constraints ensures physically sensible shape and pose changes. A composite diffusion module harmonizes lighting, color, and boundaries for seamless reintegration. Across diverse categories, ObjectMorpher delivers fine-grained, photorealistic edits with superior controllability and efficiency, outperforming 2D drag and 3D-aware baselines on KID, LPIPS, SIFID, and user preference.