摘要(英) |
Influenced by the revolutionary concept of German Industry 4.0, major manufacturing industries have been moving from automatic production into smart production for maintaining their competitiveness. Industry 4.0 advocates smart factories that use Internet-enabled assembly lines to collect large amounts of data and then through data analysis to achieve the goals of smartly adjusting production processes, intelligently saving energy, precisely forecasting customer demands, and accurately predicting mechanical failures. In general, smart factories can yield flexible and even customized products in the most efficient way. This paper focuses on estimating machine remaining useful life (RUL), which is a kind of the machine condition pre-diagnosis. By accurate RUL estimation, we can perform predictive maintenance, instead of preventive maintenance, to avoid sudden breakdown of machines/components during the operation process to prevent huge loss.
This paper proposes a Recurrent Neural Network (RNN) deep learning method to estimate the remaining useful life of machines, especially the aero-propulsion engines. The proposed method uses the Long Short-Term Memory (LSTM) model with the attention-based (AB) mechanism. The LSTM model is useful for extracting relationship between time-series data items that are far separated, and the AB mechanism can help emphasize different factors that affect the RUL in different time. The NASA C-MAPSS (Commercial Modular Aero-Propulsion System Simulation) dataset is taken to evaluate the URL estimation accuracy of the propose method. The evaluated results are compared with those of related methods, namely the MLP, SVR, RVR, CNN, Stack LSTM methods. Comparisons show that the proposed method is superior to the others in terms of the scoring function value defined by the C-MAPSS dataset, and the Root Mean Squared Error (RMSE) . |
參考文獻 |
[1] Lee, E. A. (2008, May). Cyber physical systems: Design challenges. In Object oriented real-time distributed computing (isorc), 2008 11th ieee international symposium on (pp. 363-369). IEEE.
[2] Mitchell, Tom M. "Machine learning. 1997." Burr Ridge, IL: McGraw Hill 45.37 (1997): 870-877.
[3] Rosenblatt, Frank. "The perceptron: a probabilistic model for information storage and organization in the brain." Psychological review 65.6 (1958): 386.
[4] Rumelhart, David E., Geoffrey E. Hinton, and Ronald J. Williams. "Learning representations by back-propagating errors." nature323.6088 (1986): 533.
[5] Understanding LSTM Networks:
http://colah.github.io/posts/2015-08-Understanding-LSTMs/.
[6] Hochreiter, Sepp, and Jürgen Schmidhuber. "Long short-term memory." Neural computation 9.8 (1997): 1735-1780.
[7] Xu, Kelvin, et al. "Show, attend and tell: Neural image caption generation with visual attention." International Conference on Machine Learning. 2015.
[8] Saxena, Abhinav, et al. "Damage propagation modeling for aircraft engine run-to-failure simulation." Prognostics and Health Management, 2008. PHM 2008. International Conference on. IEEE, 2008.
[9] Wang, P., Youn, B.D., Hu, C., “A generic probabilistic framework for structural health prognostics and uncertainty management”, Mech. Syst. Sig. Process. 28,
622–637 (2012).
[10] T. Wang, J. Yu, D. Siegel, J. Lee, “A similarity-based prognostics approach for remaining useful life estimation of engineered systems”, in: Proceedings of the IEEE International Conference on Prognostics and Health Management(2008).
[11] Babu, Giduthuri Sateesh, Peilin Zhao, and Xiao-Li Li. "Deep convolutional neural network based regression approach for estimation of remaining useful life." International conference on database systems for advanced applications. Springer, Cham, 2016.
[12] Chang, C.C., Lin, C.J., “LIBSVM: a library for support vector machines”, ACM Trans. Intell. Syst. Technol. 2, 27:1–27:27 (2011).
[13] Tipping, M.E., “The relevance vector machine”, in Solla, S.A., Leen, T.K., Muller, K.R. (eds.) Advances in Neural Information Processing Systems, vol. 12, pp. 652–658. MIT Press, Cambridge (2000).
[14] Che-Sheng Hsu and Jehn-Ruey Jiang, "Remaining Useful Life Estimation Using Long Short-Term Memory Deep Learning," IEEE International Conference on Applied System Innovation 2018 (IEEE ICASI 2018), 2018.
[15] Heimes, Felix O. "Recurrent neural networks for remaining useful life estimation." Prognostics and Health Management, 2008. PHM 2008. International Conference on. IEEE, 2008.
[16] Bengio, Yoshua. "Practical recommendations for gradient-based training of deep architectures." Neural networks: Tricks of the trade. Springer, Berlin, Heidelberg, 2012. 437-478.
[17] Neural Networks for Machine Learning: https://zh-tw.coursera.org/learn/neural-networks.
[18] Duchi, J., Hazan, E., & Singer, Y., “Adaptive Subgradient Methods for Online Learning and Stochastic Optimization”, Journal of Machine Learning Research, 12, 2121–2159, 2011
[19] Opitz, David W., and Richard Maclin. "Popular ensemble methods: An empirical study." J. Artif. Intell. Res.(JAIR) 11 (1999): 169-198.
[20] Keras Documentation: https://keras.io/. |