论文标题

通过无序的光纤无监督的全彩蜂窝图像重建

Unsupervised Full-color Cellular Image Reconstruction through Disordered Optical Fiber

论文作者

Hu, Xiaowen, Zhao, Jian, Antonio-Lopez, Jose Enrique, Correa, Rodrigo Amezcua, Schulzgen, Axel

论文摘要

近年来见证了将光纤成像融合的巨大发展与有监督的深度学习,以使难以到达的区域的高质量成像。然而,监督的深度学习方法对光纤成像系统施加了严格的限制,其中输入对象和纤维输出必须成对收集。为了释放光纤成像的全部潜力,需求无监督的图像重建。不幸的是,光纤束和多模纤维都无法以高采样密度来点对点传输对象,这是无监督图像重建的先决条件。最近提出的无序纤维提供了基于横向安德森本地化的新解决方案。在这里,我们通过透射和反射模式中的米长纤维进行了细胞分辨率,展示了无监督的全彩成像。无监督的图像重建由两个阶段组成。在第一阶段,我们使用对象的统计数据对光纤输出执行像素标准化。在第二阶段,我们通过生成对抗网络恢复重建的精细细节。无监督的图像重建不需要配对的图像,可以在各种条件下进行更灵活的校准。我们的新解决方案通过在初始校准后仅收集纤维输出,在工作距离至少4 mm的工作距离内实现了全彩色的高保真细胞成像。当无序纤维弯曲的中心角为60°时,还可以证明高成像鲁棒性。此外,通过多元化的对象集,表明看不见的对象上的跨域通用性已增强。

Recent years have witnessed the tremendous development of fusing fiber-optic imaging with supervised deep learning to enable high-quality imaging of hard-to-reach areas. Nevertheless, the supervised deep learning method imposes strict constraints on fiber-optic imaging systems, where the input objects and the fiber outputs have to be collected in pairs. To unleash the full potential of fiber-optic imaging, unsupervised image reconstruction is in demand. Unfortunately, neither optical fiber bundles nor multimode fibers can achieve a point-to-point transmission of the object with a high sampling density, as is a prerequisite for unsupervised image reconstruction. The recently proposed disordered fibers offer a new solution based on the transverse Anderson localization. Here, we demonstrate unsupervised full-color imaging with a cellular resolution through a meter-long disordered fiber in both transmission and reflection modes. The unsupervised image reconstruction consists of two stages. In the first stage, we perform a pixel-wise standardization on the fiber outputs using the statistics of the objects. In the second stage, we recover the fine details of the reconstructions through a generative adversarial network. Unsupervised image reconstruction does not need paired images, enabling a much more flexible calibration under various conditions. Our new solution achieves full-color high-fidelity cell imaging within a working distance of at least 4 mm by only collecting the fiber outputs after an initial calibration. High imaging robustness is also demonstrated when the disordered fiber is bent with a central angle of 60°. Moreover, the cross-domain generality on unseen objects is shown to be enhanced with a diversified object set.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源