论文标题

一个深厚的加固学习框架,用于快速诊断整个幻灯片病理图像

A Deep Reinforcement Learning Framework for Rapid Diagnosis of Whole Slide Pathological Images

论文作者

Zheng, Tingting, chen, Weixing, Li, Shuqin, Quan, Hao, Bai, Qun, Nan, Tianhang, Zheng, Song, Gao, Xinghua, Zhao, Yue, Cui, Xiaoyu

论文摘要

深度神经网络是用于组织病理学图像分析的研究热点,可以提高病理学家诊断的效率和准确性或用于疾病筛查。整个幻灯片病理图像可以达到一个GigaPixel,并包含丰富的组织特征信息,需要将其分为训练和推理阶段的许多斑块。这将导致长时间的收敛时间和大量的记忆消耗。此外,在数字病理学领域,备受宣传的数据集也供不应求。受病理学家的临床诊断过程的启发,我们提出了一个弱监督的深度强化学习框架,这可以大大减少网络推断所需的时间。我们使用神经网络分别构建搜索模型和强化学习代理的决策模型。搜索模型通过当前视场中不同大型的图像特征预测下一个动作,并且决策模型用于返回当前视图图像字段的预测概率。此外,由多个实体学习构建了专家指导的模型,该模型不仅为搜索模型提供了奖励,而且还通过知识蒸馏方法指导决策模型学习。实验结果表明,我们提出的方法可以实现快速推断和准确预测整个幻灯片图像,而无需任何像素级注释。

The deep neural network is a research hotspot for histopathological image analysis, which can improve the efficiency and accuracy of diagnosis for pathologists or be used for disease screening. The whole slide pathological image can reach one gigapixel and contains abundant tissue feature information, which needs to be divided into a lot of patches in the training and inference stages. This will lead to a long convergence time and large memory consumption. Furthermore, well-annotated data sets are also in short supply in the field of digital pathology. Inspired by the pathologist's clinical diagnosis process, we propose a weakly supervised deep reinforcement learning framework, which can greatly reduce the time required for network inference. We use neural network to construct the search model and decision model of reinforcement learning agent respectively. The search model predicts the next action through the image features of different magnifications in the current field of view, and the decision model is used to return the predicted probability of the current field of view image. In addition, an expert-guided model is constructed by multi-instance learning, which not only provides rewards for search model, but also guides decision model learning by the knowledge distillation method. Experimental results show that our proposed method can achieve fast inference and accurate prediction of whole slide images without any pixel-level annotations.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源