Probabilistic outlier detection for robust regression modeling of structural response for high-speed railway track monitoring

Abstract

Outlier detection is an important procedure taken in structural health monitoring (SHM) to create clean and reliable data. A robust time series outlier detection method incorporating a Bayesian perspective and an extreme learning machine (ELM) neural network model is proposed, with application to long-term monitoring data of ballastless tracks for high-speed railway systems. A robust sparse Bayesian ELM (SBELM) model is first established by computing the posterior probability density function of the ELM weight parameters and then marginalizing over the prediction-error precision parameter to obtain a robust nonlinear regression model between the track temperature and structural response. Both the posterior mean and the associated uncertainties of the robust SBELM model are then taken into account to compute the outlier probability for each suspicious data point, which quantifies their degree of data “outlier-ness.” It effectively takes into account the prediction uncertainty of the SBELM regression model. The method is applied to long-term monitoring data for track temperatures, and track strain and relative displacement responses, from two high-speed rail track systems where there are both slight and serious outliers. The results demonstrate that the proposed method can reliably detect outliers by quantifying the outlier probability and that the final results are robust to the selection of the “thresholds.” It is also shown that our new algorithm produces significantly improved model prediction performance after the outliers are detected and removed.

Keywords

Probabilistic outlier detection sparse Bayesian learning extreme learning machine structural health monitoring high-speed railway

Get full access to this article

View all access options for this article.

References

Worden

Dulieu-Barton

. An overview of intelligent fault detection in systems and structures. Struct Health Monit 2004; 3(1): 85–98.

Henry

Clarke

. The self-validating sensor: rationale, definitions and examples. Control Eng Pract 1993; 1(4): 585–610.

Feng

Wang

Shida

. A review of self-validating sensor technology. Sens Rev 2007; 27(1): 48–56.

Paula

Ladeira

Carvalho

, et al. Deep learning anomaly detection as support fraud investigation in Brazilian exports and anti-money laundering. In: 2016 15th IEEE international conference on machine learning and applications (ICMLA), 2016, pp. 954–960. Anaheim, CA: IEEE.

Alrawashdeh

Purdy

. Toward an online anomaly intrusion detection system based on deep learning. In: 2016 15th IEEE international conference on machine learning and applications (ICMLA), 2016, pp. 195–200. Anaheim, CA: IEEE.

Worden

Manson

Fieller

NRJ

. Damage detection using outlier analysis. J Sound Vibr 2000; 229(3): 647–667.

Dervilis

Cross

Barthorpe

, et al. Robust methods of inclusive outlier analysis for structural health monitoring. J Sound Vibr 2014; 333(20): 5181–5195.

Bao

Chen

Wei

, et al. The state of the art of data science and engineering in structural health monitoring. Engineering 2019; 5(2): 234–242.

Bao

Tang

, et al. Computer vision and deep learning–based data anomaly detection method for structural health monitoring. Struct Health Monit 2019; 18(2): 401–421.

10.

Yin

Zhang

Wang

, et al. Anomaly detection based on convolutional recurrent autoencoder for IoT time series. IEEE Trans Syst Man Cybern: Syst 2020; 52(1): 112–122.

11.

Gan

MKP

. K-means clustering with outlier removal. Pattern Recognit Lett 2017; 90: 8–14.

12.

Izakian

Pedrycz

, et al. Clustering-based anomaly detection in multivariate time series data. Appl Soft Comput 2021; 100: 106919.

13.

Park

Jeon

. Regression-based outlier detection of sensor measurements using independent variable synthesis. In: International conference on data science. Springer, Cham, 2015, pp. 78–86.

14.

Tang

Wang

, et al. Probabilistic automatic outlier detection for surface air quality measurements from the China national environmental monitoring network. Adv Atmospheric Sci 2018; 35(12): 1522–1532.

15.

Yuen

. A novel probabilistic method for robust parametric identification and outlier detection. Probab Eng Mech 2012; 30: 48–59.

16.

Yuen

Ortiz

. Outlier detection and robust regression for correlated data. Comput Methods Appl Mech Eng 2017; 313: 632–646.

17.

Rousseeuw

Hubert

. Robust statistics for outlier detection. Wiley Interdiscip Rev: Data Min Knowl Discovery 2011; 1(1): 73–79.

18.

Lai

Zha

, et al. Revisiting time series outlier detection: definitions and benchmarks. In: Thirty-fifth conference on neural information processing systems datasets and benchmarks track (Round 1), 2021.

19.

Huang

Zhu

Siew

. Extreme learning machine: theory and applications. Neurocomputing 2006; 70(1–3): 489–501.

20.

Yaseen

Sulaiman

Deo

, et al. An enhanced extreme learning machine model for river flow forecasting: state-of-the-art, practical applications in water resource engineering area and future research direction. J Hydrology 2019; 569: 387–408.

21.

Chen

Gryllias

. Mechanical fault diagnosis using convolutional neural networks and extreme learning machine. Mech Syst Signal Process 2019; 133: 106272.

22.

Ghoneim

Muhammad

Hossain

. Cervical cancer classification using convolutional neural networks and extreme learning machines. Future Gener Comput Syst 2020; 102: 643–649.

23.

Jin

Zhou

Gao

, et al. EEG classification using sparse Bayesian extreme learning machine for brain–computer interface. Neural Comput Appl 2020; 32: 6601–6609.

24.

Tipping

. Sparse Bayesian learning and the relevance vector machine. J Mach Learn Res 2001; 1: 211–244.

25.

Huang

Babri

. Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation functions. IEEE Trans Neural Networks 1998; 9(1): 224–229.

26.

Huang

Beck

, et al. Bayesian compressive sensing for approximately sparse signals and application to structural health monitoring signals for data loss recovery. Probab Eng Mech 2016; 46: 62–79.

27.

Beck

. Bayesian system identification based on probability logic. Struct Control Health Monit 2010; 17(7): 825–847.

28.

Angelikopoulos

Beck

, et al. Hierarchical stochastic model in Bayesian inference for engineering applications: theoretical implications and efficient approximation. ASCE-ASME J Risk Uncert Eng Sys Part B Mech Eng 2019; 5(1): 011006.

29.

Sedehi

Papadimitriou

Katafygiotis

. Data-driven uncertainty quantification and propagation in structural dynamics through a hierarchical Bayesian framework. Probab Eng Mech 2020; 60: 103047.

30.

Huang

Beck

. Bayesian system identification based on hierarchical sparse Bayesian learning and Gibbs sampling with application to structural damage assessment. Comput Methods Appl Mech Eng 2017; 318: 382–411.

31.

Zhao

Lehman

Ball

, et al. Outlier detection rules for fault detection in solar photovoltaic arrays. In: 2013 twenty-eighth annual IEEE applied power electronics conference and exposition (APEC), 2013, pp. 2913–2920. Long Beach, CA: IEEE.

32.

Beck

Katafygiotis

. Updating models and their uncertainties. I: Bayesian statistical framework. J Eng Mech-Proc ASCE 1998; 124(4): 455–462.