论文标题
动态场景的实时非视线成像
Real-time Non-line-of-Sight imaging of dynamic scenes
论文作者
论文摘要
非线视线(NLOS)成像旨在恢复直接视线中隐藏的物体的3D几何形状。过去,这种方法遭受了较弱的可用多声音信号限制场景大小,捕获速度和重建质量。尽管已经证明了能够以每秒几个帧重建场景重建场景的算法已被证明,但仅针对NLOS反射对象证明了实时NLOS视频,其中NLOS信号强度通过4个数量级或更多数量级增强。此外,还注意到,NLOS方法中重建的信噪比随着距离和过去的重建而迅速下降,仅限于小场景,深度很少。场景中的噪声和分辨率的实际模型很简单,忽略了问题的许多复杂性。我们证明,Spad(单相雪崩二极管)阵列探测器总共只有28个像素,并结合了特定扩展的相sor场重建算法,可以重建非反向反射NLOS场景的实时实时视频。我们提供对我们重建的信噪比(SNR)的分析,并表明,对于我们的方法,可以重建场景,使得SNR,运动模糊,角度分辨率和深度分辨率都与场景大小无关,这表明可以重建非常大的场景。将来,通过向传感器阵列添加更多像素,可以进一步提高NLOS成像系统的光效率。
Non-Line-of-Sight (NLOS) imaging aims at recovering the 3D geometry of objects that are hidden from the direct line of sight. In the past, this method has suffered from the weak available multibounce signal limiting scene size, capture speed, and reconstruction quality. While algorithms capable of reconstructing scenes at several frames per second have been demonstrated, real-time NLOS video has only been demonstrated for retro-reflective objects where the NLOS signal strength is enhanced by 4 orders of magnitude or more. Furthermore, it has also been noted that the signal-to-noise ratio of reconstructions in NLOS methods drops quickly with distance and past reconstructions, therefore, have been limited to small scenes with depths of few meters. Actual models of noise and resolution in the scene have been simplistic, ignoring many of the complexities of the problem. We show that SPAD (Single-Photon Avalanche Diode) array detectors with a total of just 28 pixels combined with a specifically extended Phasor Field reconstruction algorithm can reconstruct live real-time videos of non-retro-reflective NLOS scenes. We provide an analysis of the Signal-to-Noise-Ratio (SNR) of our reconstructions and show that for our method it is possible to reconstruct the scene such that SNR, motion blur, angular resolution, and depth resolution are all independent of scene size suggesting that reconstruction of very large scenes may be possible. In the future, the light efficiency for NLOS imaging systems can be improved further by adding more pixels to the sensor array.