论文标题
face2ppg:一条无监督的管道,用于从面部提取血量的脉冲
Face2PPG: An unsupervised pipeline for blood volume pulse extraction from faces
论文作者
论文摘要
在医学,福祉或运动等许多领域,光摄取学(PPG)信号已成为许多领域的关键技术。我们的工作提出了一组管道,以稳健,可靠和可配置从面部提取远程PPG信号(RPPG)。我们在无监督的RPPG方法的关键步骤中识别并评估可能的选择。我们在六个不同的数据集中评估了最先进的处理管道,并将重要的更正在方法中,以确保可重现和公平的比较。此外,我们通过提出三个新颖的想法来扩展管道。 1)一种根据刚性网格归一化稳定检测到的面孔的新方法; 2)一种新的方法,可以动态选择提供最佳原始信号的面部不同区域,3)基于QR分解,一种新的RGB到RGB到RGB到RGB,称为正交矩阵图像转换(省略),从而增加了针对压缩工件的鲁棒性。我们表明,这三个更改都介绍了从面部检索RPPG信号的明显改进,与无监督的,基于非学习的方法相比,获得了最先进的结果,并且在某些数据库中,非常接近受监督的,基于学习的方法。我们进行比较研究以量化每个提出的想法的贡献。此外,我们描述了一系列可以帮助将来实施的观察结果。
Photoplethysmography (PPG) signals have become a key technology in many fields, such as medicine, well-being, or sports. Our work proposes a set of pipelines to extract remote PPG signals (rPPG) from the face robustly, reliably, and configurable. We identify and evaluate the possible choices in the critical steps of unsupervised rPPG methodologies. We assess a state-of-the-art processing pipeline in six different datasets, incorporating important corrections in the methodology that ensure reproducible and fair comparisons. In addition, we extend the pipeline by proposing three novel ideas; 1) a new method to stabilize the detected face based on a rigid mesh normalization; 2) a new method to dynamically select the different regions in the face that provide the best raw signals, and 3) a new RGB to rPPG transformation method, called Orthogonal Matrix Image Transformation (OMIT) based on QR decomposition, that increases robustness against compression artifacts. We show that all three changes introduce noticeable improvements in retrieving rPPG signals from faces, obtaining state-of-the-art results compared with unsupervised, non-learning-based methodologies and, in some databases, very close to supervised, learning-based methods. We perform a comparative study to quantify the contribution of each proposed idea. In addition, we depict a series of observations that could help in future implementations.