医学影像与生物视觉 · CVPR2026 ·2026.06.03

面向3D医学视觉表征学习的掩码扩散自编码器

Masked-Diffusion Autoencoders for 3D Medical Vision Representation Learning

Jiachen Tu、Guanghui Qin、Theodore Zhengde Zhao、Jeya Maria Jose Valanarasu、Sheng Zhang、Tristan Naumann 等 9 人

与你有关的部分

把「空间掩码 + 扩散加噪」两种破坏叠加成统一的时间条件去噪目标,让同一网络同时学结构重建与纹理去噪;做3D医学(或任何低标注3D体数据)自监督预训练时,可直接借用这套双破坏预训练范式替代单一MAE或对比学习。

原文依据 imposes concurrent spatial masking and diffusion corruption, encouraging the model to learn complementary objectives
可迁移到 自监督预训练肿瘤分类分子标志物检测密集分割

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

有效的医学图像分析需要能够同时捕捉全局解剖结构与细粒度组织纹理的表征。现有的自监督方法在同时满足这两项要求方面能力有限。基于不变性的方法通过增强一致性进行学习,但在医学影像中面临挑战,因为常用增强可能丢弃具有诊断相关性的强度模式。掩码图像建模方法采用高掩码率以强制整体推理,却天然限制了对细粒度纹理的接触。近期通用视觉领域的工作表明,生成目标与语义目标可以相互促进,但这一范式在3D医学影像中尚未被探索。我们提出掩码扩散自编码器(MDAE),一个自监督框架,同时施加空间掩码与扩散破坏,促使模型学习互补目标:掩码区域重建以获得结构连贯性,可见区域去噪以获得纹理特征。这种双重破坏使网络能够在统一的时间条件目标中学习结构—纹理表征。在脑部MRI上针对肿瘤分类、分子标志物检测和密集分割基准进行评估,MDAE一致优于最优基线,且改进在跨模态泛化任务中最为显著。

英文原文摘要 1445 字符

Effective medical image analysis requires representations that capture both global anatomical structure and fine-grained tissue texture. Current self-supervised approaches exhibit limited capacity to address both requirements simultaneously. Invariance-based methods learn through augmentation consistency but face challenges in medical imaging where common augmentations may discard diagnostically relevant intensity patterns. Masked image modeling approaches employ high masking ratios to enforce holistic reasoning, yet inherently limit exposure to fine-grained texture. Recent work in general-domain vision demonstrates that generative and semantic objectives can mutually benefit each other, yet this paradigm remains unexplored for 3D medical imaging. We introduce Masked-Diffusion Autoencoders (MDAE), a self-supervised framework that imposes concurrent spatial masking and diffusion corruption, encouraging the model to learn complementary objectives: masked region reconstruction for structural coherence and visible region denoising for textural characteristics. This dual corruption enables the network to learn structure-texture representations within a unified time-conditioned objective. Evaluated on brain MRI across tumor classification, molecular marker detection, and dense segmentation benchmarks, MDAE consistently outperforms state-of-the-art baselines, with improvements most pronounced in cross-modal generalization tasks.

标签

会议 CVPR2026
页码 22804-22815
Bibkey
来源 CVF Open Access