图像分割 · CVPR2026 ·2026.06.03

聚焦背景:以背景为中心的提示词探索 SAM 在少样本医学图像分割中的潜力

Focus on Background: Exploring SAM's Potential in Few-shot Medical Image Segmentation with Background-centric Prompting

Yuntian Bo、Yazhou Zhu、Piotr Koniusz、Haofeng Zhang

与你有关的部分

把 SAM 的少样本分割重新表述为「提示词定位」任务,用类别无关的背景提示约束 SAM 的过分割;这一思路可迁移到任何需要抑制 SAM 过度分割的开放词表/少样本分割场景。

原文依据 reformulate SAM-based FSMIS as a prompt localization task
可迁移到 few-shot medical image segmentationpromptable segmentationcross-domain segmentation

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

传统的少样本医学图像分割(FSMIS)方法面临性能瓶颈,阻碍了其更广泛的临床应用。尽管 Segment Anything Model(SAM)展现出强大的类别无关分割能力,但直接将其应用于医学图像时,常因解剖边界模糊而导致过分割。本文把基于 SAM 的 FSMIS 重新表述为提示词定位任务,并提出 FoB(Focus on Background,聚焦背景),一种以背景为中心的提示词生成器,为 SAM 提供准确的背景提示词以约束其过分割。具体而言,FoB 通过类别无关地生成支持集背景提示词,并将其直接在查询图像中定位,从而弥合分割与提示词定位之间的鸿沟。为应对新类别下的提示词定位难题,FoB 对丰富的上下文信息建模,以捕捉前景与背景之间的空间依赖关系。此外,受医学图像中背景提示词固有结构模式的启发,FoB 将该结构建模为约束,以逐步细化背景提示词预测。在三个不同的医学图像数据集上的实验表明,FoB 以较大幅度优于其他基线,在 FSMIS 上取得最优性能,并展现出强大的跨域泛化能力。

英文原文摘要 1356 字符

Conventional few-shot medical image segmentation (FSMIS) approaches face performance bottlenecks that hinder broader clinical applicability. Although the Segment Anything Model (SAM) exhibits strong category-agnostic segmentation capabilities, its direct application to medical images often leads to over-segmentation due to ambiguous anatomical boundaries. In this paper, we reformulate SAM-based FSMIS as a prompt localization task and propose FoB (Focus on Background), a background-centric prompt generator that provides accurate background prompts to constrain SAM's over-segmentation. Specifically, FoB bridges the gap between segmentation and prompt localization by category-agnostic generation of support background prompts and localizing them directly in the query image. To address the challenge of prompt localization for novel categories, FoB models rich contextual information to capture foreground-background spatial dependencies. Moreover, inspired by the inherent structural patterns of background prompts in medical images, FoB models this structure as a constraint to progressively refine background prompt predictions. Experiments on three diverse medical image datasets demonstrate that FoB outperforms other baselines by large margins, achieving state-of-the-art performance on FSMIS, and exhibiting strong cross-domain generalization.

标签

会议 CVPR2026
页码 30032-30041
Bibkey
来源 CVF Open Access