自监督与表征学习 · CVPR2026 ·2026.06.03

漫画线稿图像间的区域级对应预测

Region-Wise Correspondence Prediction between Manga Line Art Images

Yingxuan Li、Jiafeng Mao、Qianru Qiu、Yusuke Matsui

与你有关的部分

提出一种无需人工标注、基于自动生成区域对应训练的 Transformer 框架,学习抑制噪声匹配并强化结构一致性,可用于漫画线稿的跨图区域匹配与特征对齐,为线稿上色和中间帧生成等下游任务提供可复用的对应预测方法。

原文依据 we propose a Transformer-based framework trained on large-scale, automatically generated region correspondences
可迁移到 区域对应预测线稿上色中间帧生成

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

理解漫画线稿图像之间的区域级对应关系是高级漫画处理的基础,可支撑线稿上色和中间帧生成等下游任务。与包含丰富视觉线索的自然图像不同,漫画线稿仅由稀疏的黑白笔画构成,这使得确定图像间哪些区域相互对应变得困难。在本工作中,我们引入一个新任务:在没有任何标注的情况下预测原始漫画线稿图像之间的区域级对应关系。为解决该问题,我们提出一个基于 Transformer 的框架,在大规模自动生成的区域对应关系上进行训练。模型学习抑制噪声匹配并强化一致的结构关系,从而在图像内部和图像之间实现鲁棒的块级特征对齐。在推理阶段,我们的方法对每个线稿进行分割,并通过边缘感知聚类和区域匹配建立连贯的区域级对应关系。我们构建了人工标注的基准用于评估,跨多个数据集的实验表明,该方法同时具有较高的块级准确率和较强的区域级对应性能,区域级准确率达到 78.4%–84.4%。这些结果凸显了我们的方法在真实漫画和动画应用中的潜力。

英文原文摘要 1344 字符

Understanding region-wise correspondences between manga line art images is fundamental for high-level manga processing, supporting downstream tasks such as line art colorization and in-between frame generation. Unlike natural images that contain rich visual cues, manga line art consists only of sparse black-and-white strokes, making it challenging to determine which regions correspond across images. In this work, we introduce a new task: predicting region-wise correspondence between raw manga line art images without any annotations. To address this problem, we propose a Transformer-based framework trained on large-scale, automatically generated region correspondences. The model learns to suppress noisy matches and strengthen consistent structural relationships, resulting in robust patch-level feature alignment within and across images. During inference, our method segments each line art and establishes coherent region-level correspondences through edge-aware clustering and region matching. We construct manually annotated benchmarks for evaluation, and experiments across multiple datasets demonstrate both high patch-level accuracy and strong region-level correspondence performance, achieving 78.4-84.4% region-level accuracy. These results highlight the potential of our method for real-world manga and animation applications.

标签

会议 CVPR2026
页码 15334-15342
Bibkey
来源 CVF Open Access