腹腔镜手术视频中出血区域与出血点的协同检测
Synergistic Bleeding Region and Point Detection in Laparoscopic Surgical Videos
把 SAM2 的掩码记忆机制改造成跨任务双向引导:掩码分支的边缘/点提示词嵌入与点分支的掩码记忆诱导点记忆互相喂信息,并用帧间光流补运动线索,这套「分割记忆→点跟踪」的耦合设计可迁移到其他需要同时输出区域与关键点的视频密集预测任务。
原文依据 The mask branch detects bleeding regions through adaptive edge and point prompt embeddings, while the point branch leverages mask memory to induce bleeding point memory modeling
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论腹腔镜手术中的术中出血会迅速遮蔽术野,阻碍手术进程并增加术后并发症风险。智能检测出血区域可量化失血量以辅助决策,而定位出血点有助于外科医生快速识别出血源、及时完成止血,从而提高手术成功率。为填补基准空白,我们首先构建了一个真实世界的腹腔镜手术出血检测数据集 SurgBlood,包含来自 95 段手术视频片段的 5,330 帧,并带有出血区域与出血点标注。在此基础上,我们开发了一个双任务协同在线检测器 BlooDet,能够同时检测腹腔镜手术中的出血区域与出血点。该基线采用基于 Segment Anything Model 2 的双分支双向引导设计。掩码分支通过自适应边缘与点提示词嵌入检测出血区域,点分支则利用掩码记忆诱导出血点记忆建模,并通过帧间光流捕捉出血点的运动方向。通过耦合的双向引导,我们的框架在挖掘时空相关性的同时利用记忆建模推断当前出血状态。大量实验表明,我们的方法在出血检测上优于 13 个对比方法。代码与数据见 https://github.com/PJLallen/SurgBlood。
英文原文摘要 1487 字符
Intraoperative bleeding in laparoscopic surgery causes rapid obscuration of the operative field to hinder the surgical process and increases the risk of postoperative complications. Intelligent detection of bleeding areas can quantify the blood loss to assist decision-making, while locating bleeding points helps surgeons quickly identify the source of bleeding and achieve hemostasis in time to improve surgical success rates. To fill the benchmark gap, we first construct a real-world laparoscopic surgical bleeding detection dataset, named SurgBlood, comprising 5,330 frames from 95 surgical video clips with bleeding region and point annotations. Accordingly, we develop a dual-task synergistic online detector called BlooDet, enabling simultaneous detection of bleeding regions and points in laparoscopic surgery. The baseline embraces a dual-branch bidirectional guidance design based on Segment Anything Model 2. The mask branch detects bleeding regions through adaptive edge and point prompt embeddings, while the point branch leverages mask memory to induce bleeding point memory modeling and captures point motion direction via inter-frame optical flow. By coupled bidirectional guidance, our framework explores spatial-temporal correlations while exploiting memory modeling to infer current bleeding status. Extensive experiments indicate that our method outperforms 13 counterparts in bleeding detection. Code and data are available at https://github.com/PJLallen/SurgBlood.