图像编辑与可控生成 · CVPR2026 ·2026.06.03

并非所有鸟都长得一样:面向鸟类的身份保持生成

Not All Birds Look The Same: Identity-Preserving Generation For Birds

Aaron Sun、Oindrila Saha、Subhransu Maji

与你有关的部分

针对非刚性细粒度类别(鸟类)的身份保持生成,提出按物种、年龄、性别分组训练作为身份代理,可迁移到其他缺乏多视角/视频数据的细粒度域(如动植物、时尚单品)的定制化生成。

原文依据 training on images grouped by species, age, and sex--used as a proxy for identity--substantially improves performance on both seen and unseen species.
可迁移到 身份保持图像生成细粒度图像识别零样本定制化生成

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

自可控图像生成问世以来,日益丰富的控制模式为普通用户带来了更强的定制性与可及性。诸如 Insert Anything 与 OminiControl 等零样本身份保持模型现已支持虚拟试穿等应用,且无需额外微调。尽管这些模型可能适用于人类和刚性日常物体,但对于非刚性或细粒度类别仍存在局限。这些领域往往缺乏可获取的高质量数据——尤其是同一主体的视频或多视角观测——使其难以评估和改进。然而,这些领域对于从内容创作迈向要求准确性和精细细节的应用至关重要。鸟类是该任务的绝佳领域:它们展现出高度多样性,识别需要细粒度线索,且姿态多种多样。我们引入 NABirds Look-Alikes (NABLA) 数据集,包含 4,759 对专家精选的图像对。结合从 iNaturalist 多图像观测中收集的 1,073 对图像以及少量视频,这构成了评估鸟类身份保持生成的基准。我们表明最优基线在该数据集上无法保持身份,并证明按物种、年龄和性别分组图像(作为身份的代理)进行训练,能在已见和未见物种上均显著提升性能。

英文原文摘要 1474 字符

Since the advent of controllable image generation, increasingly rich modes of control have enabled greater customization and accessibility for everyday users.Zero-shot, identity-preserving models such as Insert Anything and OminiControl now support applications like virtual try-on without requiring additional fine-tuning.While these models may be fitting for humans and rigid everyday objects, they still have limitations for non-rigid or fine-grained categories. These domains often lack accessible, high-quality data--especially videos or multi-view observations of the same subject--making them difficult both to evaluate and to improve upon. Yet, such domains are essential for moving beyond content creation toward applications that demand accuracy and fine detail.Birds are an excellent domain for this task: they exhibit high diversity, require fine-grained cues for identification, and come in a wide variety of poses. We introduce the NABirds Look-Alikes (NABLA) dataset, consisting of 4,759 expert-curated image pairs. Together with 1,073 pairs collected from multi-image observations on iNaturalist and a small set of videos, this forms a benchmark for evaluating identity-preserving generation of birds.We show that state-of-the-art baselines fail to maintain identity on this dataset, and we demonstrate that training on images grouped by species, age, and sex--used as a proxy for identity--substantially improves performance on both seen and unseen species.

标签

会议 CVPR2026
页码 1983-1993
Bibkey
来源 CVF Open Access