论文标题
快速组织氧合映射从快照结构化图像,具有对抗性深度学习
Rapid tissue oxygenation mapping from snapshot structured-light images with adversarial deep learning
论文作者
论文摘要
空间频域成像(SFDI)是一种在广阔视野上绘制组织氧饱和度的强大技术。但是,当前的SFDI方法要么需要几个具有不同照明模式的图像的序列,要么在单个快照光学特性(SSOP)的情况下引入伪影并牺牲准确性。为了避免这种权衡,我们引入了Oxygan:一种数据驱动的内容感知方法,可以使用端到端的生成对抗网络直接从单个结构化光图像中估算组织氧合。常规的SFDI用于获得人体食管,体内手和脚的地面真相组织氧合图,以及在659 nm和851 nm正弦照明下的体内猪结肠样品。我们通过与SSOP和两步混合技术进行比较,该技术使用先前开发的深度学习模型来预测光学性质,然后是物理模型来计算组织氧合的方法。当在人脚上进行测试时,精确度为96.5%的交叉验证的Oxygan映射组织氧化。当应用于训练集未包括的样品类型时,例如人手和猪结肠,Oxygan的精度达到了93.0%的精度,证明了各种组织类型的稳健性。平均而言,Oxygan的表现分别优于SSOP和杂种模型,分别估计组织氧合的24.9%和24.7%。最后,我们优化了Oxygan推断,以便计算出比以前的工作快10倍,从而使视频速率(25Hz成像)。由于其快速获取和加工速度,Oxygan有可能实现实时,高保真组织氧合映射,这可能对许多临床应用有用。
Spatial frequency domain imaging (SFDI) is a powerful technique for mapping tissue oxygen saturation over a wide field of view. However, current SFDI methods either require a sequence of several images with different illumination patterns or, in the case of single snapshot optical properties (SSOP), introduce artifacts and sacrifice accuracy. To avoid this tradeoff, we introduce OxyGAN: a data-driven, content-aware method to estimate tissue oxygenation directly from single structured light images using end-to-end generative adversarial networks. Conventional SFDI is used to obtain ground truth tissue oxygenation maps for ex vivo human esophagi, in vivo hands and feet, and an in vivo pig colon sample under 659 nm and 851 nm sinusoidal illumination. We benchmark OxyGAN by comparing to SSOP and to a two-step hybrid technique that uses a previously-developed deep learning model to predict optical properties followed by a physical model to calculate tissue oxygenation. When tested on human feet, a cross-validated OxyGAN maps tissue oxygenation with an accuracy of 96.5%. When applied to sample types not included in the training set, such as human hands and pig colon, OxyGAN achieves a 93.0% accuracy, demonstrating robustness to various tissue types. On average, OxyGAN outperforms SSOP and a hybrid model in estimating tissue oxygenation by 24.9% and 24.7%, respectively. Lastly, we optimize OxyGAN inference so that oxygenation maps are computed ~10 times faster than previous work, enabling video-rate, 25Hz imaging. Due to its rapid acquisition and processing speed, OxyGAN has the potential to enable real-time, high-fidelity tissue oxygenation mapping that may be useful for many clinical applications.