通过补全任意量化码实现脑部MRI虚拟全栈扫描
Virtual Full-stack Scanning of Brain MRI via Imputing Any Quantised Code
将任意到任意的MRI模态补全统一为区域级全栈码预测问题,利用矢量量化编码完整模态集并训练投影编码器从缺失模态预测码图,为多模态医学影像的缺失数据补全提供了可复用的两阶段框架。
原文依据 reformulates various "any-to-any" imputation tasks as a region-level full-stack code prediction problem
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论磁共振成像(MRI)是一种强大且多功能的成像技术,通过采用不同的采集模态提供关于解剖结构的广泛信息。然而,在临床工作流程中,由于扫描时间和成本的限制,收集所有相关模态是不切实际的。虚拟全栈扫描旨在从可用但不完整的采集数据中补全缺失的MRI模态,提供一种经济高效的解决方案来增强数据完整性和临床可用性。现有的补全方法通常依赖于全局条件或模态特定设计,这限制了它们在不同患者队列和成像协议之间的泛化能力。为了解决这些限制,我们提出了CodeBrain,一个统一的框架,将各种“任意到任意”的补全任务重新表述为区域级全栈码预测问题。CodeBrain采用两阶段流程:(1)通过将完整的MRI模态集在区域级编码为标量量化码来学习其紧凑表示,从而在解码这些码以及模态无关的公共特征后实现高保真图像重建;(2)训练一个投影编码器,通过基于分级的设计从缺失模态中预测全栈码图,以适应多样化的补全场景。在两个公开的脑部MRI数据集(即IXI和BraTS 2023)上进行的大量实验表明,CodeBrain始终优于最优方法,为统一脑部MRI补全建立了新的基准,并实现了虚拟全栈扫描。我们的代码将在https://github.com/ycwu1997/CodeBrain发布。
英文原文摘要 1652 字符
Magnetic resonance imaging (MRI) is a powerful and versatile imaging technique, offering a wide spectrum of information about the anatomy by employing different acquisition modalities. However, in the clinical workflow, it is impractical to collect all relevant modalities due to the scan time and cost constraints. Virtual full-stack scanning aims to impute missing MRI modalities from available but incomplete acquisitions, offering a cost-efficient solution to enhance data completeness and clinical usability. Existing imputation methods often depend on global conditioning or modality-specific designs, which limit their generalisability across patient cohorts and imaging protocols. To address these limitations, we propose CodeBrain, a unified framework that reformulates various "any-to-any" imputation tasks as a region-level full-stack code prediction problem. CodeBrain adopts a two-stage pipeline: (1) it learns the compact representation of a complete MRI modality set by encoding it into scalar-quantised codes at the region level, enabling high-fidelity image reconstruction after decoding these codes along with modality-agnostic common features; (2) it trains a projection encoder to predict the full-stack code map from incomplete modalities via a grading-based design for diverse imputation scenarios. Extensive experiments on two public brain MRI datasets, i.e., IXI and BraTS 2023, demonstrate that CodeBrain consistently outperforms state-of-the-art methods, establishing a new benchmark for unified brain MRI imputation and enabling virtual full-stack scanning. Our code will be released at https://github.com/ycwu1997/CodeBrain.