论文标题
使用深度学习和改进的CSR-DCF,在相对比显微镜图像序列中的精子检测和跟踪
Sperm Detection and Tracking in Phase-Contrast Microscopy Image Sequences using Deep Learning and Modified CSR-DCF
论文作者
论文摘要
如今,计算机辅助精子分析(CASA)系统在提取精子的特征方面取得了重大飞跃,以进行研究或测量人类的生育能力。精子特征分析的第一步是视频样品框架中的精子检测。在本文中,我们使用了Retinanet,这是一个深层完全卷积神经网络作为对象检测器。精子是很少属性的小物体,这使得检测在高密度样品中更加困难,尤其是当精液中的其他颗粒可能像精子头一样。精子的主要属性之一是它们的运动,但是当仅将一个帧馈送到网络时,就无法提取此属性。为了提高精子检测网络的性能,我们串联了一些连续的帧,以用作网络的输入。通过这种方法,还提取了运动属性,然后在深度卷积网络的帮助下,我们在精子检测方面达到了很高的精度。第二步是跟踪精子,用于提取用于表明生育能力和其他精子研究至关重要的运动参数。在跟踪阶段,我们修改CSR-DCF算法。该方法还显示了精子跟踪的出色结果,即使在高密度的精子样本,遮挡,精子碰撞以及精子从框架中退出并在接下来的框架中重新输入时。检测阶段的平均精度为99.1%,跟踪方法评估的F1得分为96.61%。这些结果在研究精子行为和分析生育可能性的研究方面可能有很大的帮助。
Nowadays, computer-aided sperm analysis (CASA) systems have made a big leap in extracting the characteristics of spermatozoa for studies or measuring human fertility. The first step in sperm characteristics analysis is sperm detection in the frames of the video sample. In this article, we used RetinaNet, a deep fully convolutional neural network as the object detector. Sperms are small objects with few attributes, that makes the detection more difficult in high-density samples and especially when there are other particles in semen, which could be like sperm heads. One of the main attributes of sperms is their movement, but this attribute cannot be extracted when only one frame would be fed to the network. To improve the performance of the sperm detection network, we concatenated some consecutive frames to use as the input of the network. With this method, the motility attribute has also been extracted, and then with the help of the deep convolutional network, we have achieved high accuracy in sperm detection. The second step is tracking the sperms, for extracting the motility parameters that are essential for indicating fertility and other studies on sperms. In the tracking phase, we modify the CSR-DCF algorithm. This method also has shown excellent results in sperm tracking even in high-density sperm samples, occlusions, sperm colliding, and when sperms exit from a frame and re-enter in the next frames. The average precision of the detection phase is 99.1%, and the F1 score of the tracking method evaluation is 96.61%. These results can be a great help in studies investigating sperm behavior and analyzing fertility possibility.