论文标题
MMFALL:使用4D MMWAVE雷达和混合变量RNN自动编码器检测到秋季检测
mmFall: Fall Detection using 4D MmWave Radar and a Hybrid Variational RNN AutoEncoder
论文作者
论文摘要
在本文中,我们提出了MMFALL-一种新颖的秋季检测系统,该系统包括(i)新兴毫米波(MMWave)雷达传感器,以收集人体的点云以及(ii)变性的经常性自动装备器(VRAE),以计算基于获得的点点斑点的动态运动水平。据称当峰值处于异常水平并同时发生质心高度下降时发生跌落。 MMWave雷达传感器比传统的感应方式提供了几个优点,例如隐私遵守和对运动的高敏性。但是,(i)雷达点云数据中的随机性和(ii)传统监督秋季检测方法中秋季收集/标签的困难是两个主要挑战。为了克服雷达数据中的随机性,提出的VRAE使用变分推断,一种概率方法,而不是传统的确定性方法,以推断每个框架处人体潜在运动状态的后验概率,然后是经常性神经网络(RNN),以学习多个帧的运动时间特征。此外,为了避免秋季数据收集/标签的困难,VRAE以半监督的方法建立在自动编码器体系结构的基础上,并且仅接受了日常生活的正常活动(ADL)的培训,因此在推理阶段,VRAE在距离内会在异常运动中产生一个异常运动,例如秋季,例如秋季。在实验过程中,我们与另外两个基线一起实施了VRAE,并在收集的公寓中进行了测试。接收器操作特性(ROC)曲线表明,我们的建议模型的表现优于其他两个基线,并且在50次跌落中以98%的速度以仅2个错误的警报为代价。
In this paper we propose mmFall - a novel fall detection system, which comprises of (i) the emerging millimeter-wave (mmWave) radar sensor to collect the human body's point cloud along with the body centroid, and (ii) a variational recurrent autoencoder (VRAE) to compute the anomaly level of the body motion based on the acquired point cloud. A fall is claimed to have occurred when the spike in anomaly level and the drop in centroid height occur simultaneously. The mmWave radar sensor provides several advantages, such as privacycompliance and high-sensitivity to motion, over the traditional sensing modalities. However, (i) randomness in radar point cloud data and (ii) difficulties in fall collection/labeling in the traditional supervised fall detection approaches are the two main challenges. To overcome the randomness in radar data, the proposed VRAE uses variational inference, a probabilistic approach rather than the traditional deterministic approach, to infer the posterior probability of the body's latent motion state at each frame, followed by a recurrent neural network (RNN) to learn the temporal features of the motion over multiple frames. Moreover, to circumvent the difficulties in fall data collection/labeling, the VRAE is built upon an autoencoder architecture in a semi-supervised approach, and trained on only normal activities of daily living (ADL) such that in the inference stage the VRAE will generate a spike in the anomaly level once an abnormal motion, such as fall, occurs. During the experiment, we implemented the VRAE along with two other baselines, and tested on the dataset collected in an apartment. The receiver operating characteristic (ROC) curve indicates that our proposed model outperforms the other two baselines, and achieves 98% detection out of 50 falls at the expense of just 2 false alarms.