论文标题
ME-NET:脑肿瘤分割的多编码器网络框架
ME-Net: Multi-Encoder Net Framework for Brain Tumor Segmentation
论文作者
论文摘要
神经胶质瘤是最常见和侵略性的脑肿瘤。磁共振成像(MRI)在评估肿瘤的排列和后续程序的治疗方面起着至关重要的作用。但是,MRI图像的手动分割非常艰苦,这限制了其临床应用。随着深度学习的发展,已经开发了大量的自动分割方法,但其中大多数留在2D图像中,这导致了低于标准的性能。此外,脑肿瘤与背景之间的严重体素不平衡以及脑肿瘤的不同大小和位置使3D图像的分割成为一个具有挑战性的问题。为了分割3D MRI,我们提出了一个用多个编码器进行脑肿瘤分割的模型。该结构包含四个编码器和一个解码器。四个编码器对应于MRI图像的四个模式,执行一对一的特征提取,然后将四个模态的特征图合并到解码器中。该方法减少了特征提取的难度,并大大提高了模型性能。我们还引入了一个名为“分类骰子”的新损失函数,并同时为不同分段区域设置了不同的权重,这解决了体素不平衡问题。我们使用在线Brats 2020挑战验证评估了我们的方法。与完整肿瘤,肿瘤核心和增强肿瘤的骰子得分分别为0.70249、0.88267和0.73864相比,我们提出的方法可以在验证集中获得有希望的结果。
Glioma is the most common and aggressive brain tumor. Magnetic resonance imaging (MRI) plays a vital role to evaluate tumors for the arrangement of tumor surgery and the treatment of subsequent procedures. However, the manual segmentation of the MRI image is strenuous, which limits its clinical application. With the development of deep learning, a large number of automatic segmentation methods have been developed, but most of them stay in 2D images, which leads to subpar performance. Moreover, the serious voxel imbalance between the brain tumor and the background as well as the different sizes and locations of the brain tumor makes the segmentation of 3D images a challenging problem. Aiming at segmenting 3D MRI, we propose a model for brain tumor segmentation with multiple encoders. The structure contains four encoders and one decoder. The four encoders correspond to the four modalities of the MRI image, perform one-to-one feature extraction, and then merge the feature maps of the four modalities into the decoder. This method reduces the difficulty of feature extraction and greatly improves model performance. We also introduced a new loss function named "Categorical Dice", and set different weights for different segmented regions at the same time, which solved the problem of voxel imbalance. We evaluated our approach using the online BraTS 2020 Challenge verification. Our proposed method can achieve promising results in the validation set compared to the state-of-the-art approaches with Dice scores of 0.70249, 0.88267, and 0.73864 for the intact tumor, tumor core, and enhanced tumor, respectively.