论文标题

对机器剩余使用寿命预测的序列模型的注意序列

Attention Sequence to Sequence Model for Machine Remaining Useful Life Prediction

论文作者

Ragab, Mohamed, Chen, Zhenghua, Wu, Min, Kwoh, Chee-Keong, Yan, Ruqiang, Li, Xiaoli

论文摘要

对工业设备的剩余寿命(RUL)进行准确估算可以实现高级维护时间表,增加设备的可用性并降低运营成本。但是,由于以下两个原因,现有的Rul预测的深度学习方法并没有完全成功。首先,依靠一个目标函数来估计RUL将限制学习的表示形式,从而影响预测准确性。其次,虽然更长的序列在建模设备的传感器动力学方面更有信息,但现有方法的处理方式较小,因为它们主要关注最新信息,因此处理很长的序列。为了解决这两个问题,我们开发了一种基于辅助任务(ATS2S)模型序列的新型基于注意力的序列。特别是,我们的模型共同优化了重建损失,以通过预测能力(通过预测给定当前输入序列的下一个输入序列)和RUL预测损失,以最大程度地减少预测的RUL和实际RUL之间的差异。此外,为了更好地处理更长的顺序,我们采用了注意机制来专注于训练过程中所有重要的输入信息。最后,我们提出了一个新的双贴特功能表示形式,以集成编码器功能和解码器隐藏状态,以捕获数据中的丰富语义信息。我们在四个实际数据集上进行了广泛的实验,以评估所提出方法的功效。实验结果表明,我们提出的方法可以始终如一地超过13种最先进的方法。

Accurate estimation of remaining useful life (RUL) of industrial equipment can enable advanced maintenance schedules, increase equipment availability and reduce operational costs. However, existing deep learning methods for RUL prediction are not completely successful due to the following two reasons. First, relying on a single objective function to estimate the RUL will limit the learned representations and thus affect the prediction accuracy. Second, while longer sequences are more informative for modelling the sensor dynamics of equipment, existing methods are less effective to deal with very long sequences, as they mainly focus on the latest information. To address these two problems, we develop a novel attention-based sequence to sequence with auxiliary task (ATS2S) model. In particular, our model jointly optimizes both reconstruction loss to empower our model with predictive capabilities (by predicting next input sequence given current input sequence) and RUL prediction loss to minimize the difference between the predicted RUL and actual RUL. Furthermore, to better handle longer sequence, we employ the attention mechanism to focus on all the important input information during training process. Finally, we propose a new dual-latent feature representation to integrate the encoder features and decoder hidden states, to capture rich semantic information in data. We conduct extensive experiments on four real datasets to evaluate the efficacy of the proposed method. Experimental results show that our proposed method can achieve superior performance over 13 state-of-the-art methods consistently.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源