论文标题

onix:X射线深度学习工具,用于稀疏视图的3D重建

ONIX: an X-ray deep-learning tool for 3D reconstructions from sparse views

论文作者

Zhang, Yuhe, Yao, Zisheng, Ritschel, Tobias, Villanueva-Perez, Pablo

论文摘要

三维(3D)X射线成像技术(如断层扫描和共聚焦显微镜)对于学术和工业应用至关重要。这些方法通过扫描样品相对于X射线源访问3D信息。但是,扫描过程在研究动态时限制了时间分辨率,并且对于某些应用,例如医疗应用中的手术指导。 X射线立体镜和多投影成像是不可能扫描时获得3D信息的替代方法。但是,这些方法与传统的3D扫描技术相比仅获得少量的观点或预测,因此这些方法的体积信息有限。在这里,我们提出了Onix(优化的神经隐式X射线成像),这是一种能够从仅从一组稀疏的投影中检索具有任意大分辨率的3D对象的深度学习算法。 onix,尽管它无法访问任何体积信息,但优于当前3D重建方法,因为它包括带有X射线的图像形成的物理学,并且在不同的实验上对相似样品进行了概括,以克服稀疏视图提供的有限的体积信息。我们通过将其应用于模拟和实验性数据集,最多可获取八个投影,从而证明了与最新的层析成像重建算法相比,ONIX的功能。我们预计,i)通过i)通过与X射线多预测成像一起实现今天无法实现快速动力学的研究将成为X射线社区的关键工具,ii)增强了医疗应用中X射线立体成像的体积信息和能力。

Three-dimensional (3D) X-ray imaging techniques like tomography and confocal microscopy are crucial for academic and industrial applications. These approaches access 3D information by scanning the sample with respect to the X-ray source. However, the scanning process limits the temporal resolution when studying dynamics and is not feasible for some applications, such as surgical guidance in medical applications. Alternatives to obtaining 3D information when scanning is not possible are X-ray stereoscopy and multi-projection imaging. However, these approaches suffer from limited volumetric information as they only acquire a small number of views or projections compared to traditional 3D scanning techniques. Here, we present ONIX (Optimized Neural Implicit X-ray imaging), a deep-learning algorithm capable of retrieving 3D objects with arbitrary large resolution from only a set of sparse projections. ONIX, although it does not have access to any volumetric information, outperforms current 3D reconstruction approaches because it includes the physics of image formation with X-rays, and it generalizes across different experiments over similar samples to overcome the limited volumetric information provided by sparse views. We demonstrate the capabilities of ONIX compared to state-of-the-art tomographic reconstruction algorithms by applying it to simulated and experimental datasets, where a maximum of eight projections are acquired. We anticipate that ONIX will become a crucial tool for the X-ray community by i) enabling the study of fast dynamics not possible today when implemented together with X-ray multi-projection imaging, and ii) enhancing the volumetric information and capabilities of X-ray stereoscopic imaging in medical applications.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源