论文标题
通过自我监督的学习和批处理知识结合起来,提高自动covid-19检测性能
Boosting Automatic COVID-19 Detection Performance with Self-Supervised Learning and Batch Knowledge Ensembling
论文作者
论文摘要
问题:从胸部X射线(CXR)图像中检测COVID-19已成为检测Covid-19的最快,最简单的方法之一。但是,现有方法通常使用从自然图像中进行监督的转移学习作为训练过程。这些方法不考虑Covid-19的独特特征以及Covid-19和其他肺炎之间的类似特征。目的:在本文中,我们想设计一种使用CXR图像的新型高准确性Covid-19检测方法,该方法可以考虑Covid-19的独特特征以及Covid-19和其他肺炎之间的类似特征。方法:我们的方法包括两个阶段。一个是基于学习的基于学习的有关;另一个是基于批处理知识的微调。基于学习的基于学习的预科可以学习与CXR图像的区分表示形式,而无需手动注释标签。另一方面,基于批处理知识的基于结合的微调可以根据其视觉特征相似性在批处理中使用类别知识来提高检测性能。与以前的实施不同,我们将批处理知识结合到微调阶段,从而减少了自我监督学习中使用的记忆,并提高了COVID-19的检测准确性。结果:在两个公共COVID-19 CXR数据集中,即一个大数据集和一个不平衡的数据集,我们的方法表现出有希望的COVID-19检测性能。即使注释的CXR训练图像显着降低(例如,仅使用原始数据集的10%),我们的方法仍保持高检测精度。此外,我们的方法对超参数的变化不敏感。
Problem: Detecting COVID-19 from chest X-Ray (CXR) images has become one of the fastest and easiest methods for detecting COVID-19. However, the existing methods usually use supervised transfer learning from natural images as a pretraining process. These methods do not consider the unique features of COVID-19 and the similar features between COVID-19 and other pneumonia. Aim: In this paper, we want to design a novel high-accuracy COVID-19 detection method that uses CXR images, which can consider the unique features of COVID-19 and the similar features between COVID-19 and other pneumonia. Methods: Our method consists of two phases. One is self-supervised learning-based pertaining; the other is batch knowledge ensembling-based fine-tuning. Self-supervised learning-based pretraining can learn distinguished representations from CXR images without manually annotated labels. On the other hand, batch knowledge ensembling-based fine-tuning can utilize category knowledge of images in a batch according to their visual feature similarities to improve detection performance. Unlike our previous implementation, we introduce batch knowledge ensembling into the fine-tuning phase, reducing the memory used in self-supervised learning and improving COVID-19 detection accuracy. Results: On two public COVID-19 CXR datasets, namely, a large dataset and an unbalanced dataset, our method exhibited promising COVID-19 detection performance. Our method maintains high detection accuracy even when annotated CXR training images are reduced significantly (e.g., using only 10% of the original dataset). In addition, our method is insensitive to changes in hyperparameters.