论文标题

胸部X射线的自动放射报告生成,端到端的深度学习

Automated Radiological Report Generation For Chest X-Rays With Weakly-Supervised End-to-End Deep Learning

论文作者

Zhang, Shuai, Xin, Xiaoyan, Wang, Yang, Guo, Yachong, Hao, Qiuqiao, Yang, Xianfeng, Wang, Jun, Zhang, Jian, Zhang, Bing, Wang, Wei

论文摘要

胸部X射线(CXR)是用于诊断胸部疾病和异常的最常见临床检查之一。每天在医院中产生的CXR扫描量很大。因此,能够保存医生努力的自动诊断系统具有很大的价值。目前,人工智能在CXR诊断中的应用通常使用模式识别来对扫描进行分类。但是,此类方法依赖于标记的数据库,这些数据库昂贵并且通常具有较大的错误率。在这项工作中,我们构建了一个包含12,000多个CXR扫描和放射学报告的数据库,并开发了一个基于深层卷积神经网络和具有注意机制的经常性网络的模型。该模型从CXR扫描和相关的原始放射学报告中学习功能。不需要扫描的其他标签。该模型提供了对给定扫描和生成报告的自动识别。也通过苹果酒分数和放射科医生评估了生成的报告的质量。发现测试数据集的苹果分数平均约为5.8。进一步的盲目评估表明与人类放射科医生的表现可比。

The chest X-Ray (CXR) is the one of the most common clinical exam used to diagnose thoracic diseases and abnormalities. The volume of CXR scans generated daily in hospitals is huge. Therefore, an automated diagnosis system able to save the effort of doctors is of great value. At present, the applications of artificial intelligence in CXR diagnosis usually use pattern recognition to classify the scans. However, such methods rely on labeled databases, which are costly and usually have large error rates. In this work, we built a database containing more than 12,000 CXR scans and radiological reports, and developed a model based on deep convolutional neural network and recurrent network with attention mechanism. The model learns features from the CXR scans and the associated raw radiological reports directly; no additional labeling of the scans are needed. The model provides automated recognition of given scans and generation of reports. The quality of the generated reports was evaluated with both the CIDEr scores and by radiologists as well. The CIDEr scores are found to be around 5.8 on average for the testing dataset. Further blind evaluation suggested a comparable performance against human radiologist.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源