Conception and evaluation of anomaly detection models for monitoring analytical parameters in wastewater treatment plants

Abstract

The exponential growth of technology in recent decades has led to the emergence of some challenges inherent to this growth. One of these challenges is the enormous amount of data collected by the different sensors in our society, namely in management processes such as Wastewater Treatment Plants (WWTPs). These infrastructures comprise several processes to treat wastewater and discharge clean water in water courses. Therefore, the concentration of pollutants must be below the allowable emissions limits. In this work, anomaly detection models were conceived, tuned and evaluated to monitor essential parameters such as nitrate and ammonia concentrations and pH to improve WWTP management. Four Machine Learning models were considered, particularly Local Outlier Fraction, Isolation Forest, One-Class Support Vector Machines and Long Short-Term Memory-Autoencoders (LSTM-AE), to detect anomalies in the three parameters mentioned. Through the different experiments, it was possible to verify that, in terms of F1-Score, the best candidate model for the three analyzed parameters was LSTM-AE-based, with a value consistently higher than 97%.

Keywords

Anomaly detection chemical parameters deep learning machine learning wastewater management

Get full access to this article

View all access options for this article.

References

R.A.A.

Habeeb,

Nasaruddin,

Gani,

I.A.T.

Hashem,

Ahmed and

Imran, Real-time big data processing for anomaly detection: A survey, International Journal of Information Management45 (2019), 289–307. doi:10.1016/j.ijinfomgt.2018.08.006.

Ferraris,

Mazzoleni,

Devalle and

Couturier, Big data analytics capabilities and knowledge management: Impact on firm performance, Management Decision57(8) (2019), 1923–1936. doi:10.1108/MD-07-2018-0825.

Fernandes,

J.J.

Rodrigues,

L.F.

Carvalho,

J.F.

Al-Muhtadi and

M.L.

Proença, A comprehensive survey on network anomaly detection, Telecommunication Systems70 (2019), 447–489. doi:10.1007/s11235-018-0475-8.

Xu,

Liu and

Yao, Recent progress of anomaly detection, Complexity2019 (2019). doi:10.1155/2019/2686378.

Ullah,

I.U.

Haq,

Muhammad,

Sajjad and

S.W.

Baik, CNN features with bi-directional LSTM for real-time anomaly detection in surveillance networks, Multimedia tools and applications80 (2021), 16979–16995. doi:10.1007/s11042-020-09406-3.

P.V.

de Campos Souza,

A.J.

Guimarães,

T.S.

Rezende,

V.J.

Silva Araujo and

V.S.

Araujo, Detection of anomalies in large-scale cyberattacks using fuzzy neural networks, AI1(1) (2020), 5. doi:10.3390/ai1010005.

Kamat and

Sugandhi, Anomaly detection for predictive maintenance in industry 4.0-A survey, E3S Web of Conferences170 (2020). EDP Sciences, 02007. doi:10.1051/e3sconf/202017002007.

B.R.

Kiran,

D.M.

Thomas and

Parakkal, An overview of deep learning based methods for unsupervised and semi-supervised anomaly detection in videos, Journal of Imaging4(2) (2018), 36. doi:10.3390/jimaging4020036.

N.B.

Chikodili,

M.D.

Abdulmalik,

O.A.

Abisoye and

S.A.

Bashir, Outlier detection in multivariate time series data using a fusion of K-medoid, standardized Euclidean distance and Z-score, in: International Conference on Information and Communication Technology and Applications, Springer International Publishing, Cham, 2020, pp. 259–271. doi:10.1007/978-3-030-69143-1_21.

10.

Farhi,

Kohen,

Mamane and

Shavitt, Prediction of wastewater treatment quality using LSTM neural network, Environmental Technology & Innovation23 (2021), 101632. doi:10.1016/j.eti.2021.101632.

11.

E.M.

Dogo,

N.I.

Nwulu,

Twala and

Aigbavboa, A survey of machine learning methods applied to anomaly detection on drinking-water quality data, Urban Water Journal16(3) (2019), 235–248. doi:10.1080/1573062X.2019.1637002.

12.

Zhu,

Wang,

Yang,

Zhang,

Ren and

Ye, A review of the application of machine learning in water quality evaluation, Eco-Environment & Health. (2022). doi:10.1016/j.eehl.2022.06.001.

13.

Tchobanoglus,

Burton and

H.D.

Stensel, Wastewater engineering: Treatment and reuse, American Water Works Association. Journal95(5) (2003), 201.

14.

Yun,

Li,

Y.H.

Chen,

Saino,

Cheng and

Zheng, Elimination of nitrate in secondary effluent of wastewater treatment plants by Fe0 and Pd-Cu/diatomite, Journal of Water Reuse and Desalination8(1) (2018), 29–37. doi:10.2166/wrd.2016.122.

15.

Seliya,

Abdollah Zadeh and

T.M.

Khoshgoftaar, A literature review on one-class classification and its potential applications in big data, Journal of Big Data8(1) (2021), 1–31. doi:10.1186/s40537-021-00514-x.

16.

M.T.

Guerreiro,

E.M.A.

Guerreiro,

T.M.

Barchi,

Biluca,

T.A.

Alves,

de Souza Tadano and

H.V.

Siqueira, Anomaly detection in automotive industry using clustering methods—a case study, Applied Sciences11(21) (2021), 9868. doi:10.3390/app11219868.

17.

R.C.

Ripan,

I.H.

Sarker,

S.M.M.

Hossain,

M.M.

Anwar,

Nowrozy,

M.M.

Hoque and

M.H.

Furhad, A data-driven heart disease prediction model through K-means clustering-based anomaly detection, SN Computer Science2 (2021), 1–12. doi:10.1007/s42979-021-00518-7.

18.

Xiong and

Zuo, Recognizing multivariate geochemical anomalies for mineral exploration by combining deep learning and one-class support vector machine, Computers & geosciences140 (2020), 104484. doi:10.1016/j.cageo.2020.104484.

19.

Feng and

Li, Urban built-up area change detection using multi-band temporal texture and one-class random forest, in: 2019 10th International Workshop on the Analysis of Multitemporal Remote Sensing Images (MultiTemp), IEEE, 2019, pp. 1–4. doi:10.1109/Multi-Temp.2019.8866936.

20.

Gupta and

Mittal, Arrhythmia detection in ECG signal using fractional wavelet transform with principal component analysis, Journal of The Institution of Engineers (India): Series B101(5) (2020), 451–461. doi:10.1007/s40031-020-00488-z.

21.

E.H.

Budiarto,

A.E.

Permanasari and

Fauziati, Unsupervised anomaly detection using K-means, local outlier factor and one class SVM, in: 2019 5th International Conference on Science and Technology (ICST), Vol. 1, IEEE, 2019, pp. 1–5. doi:10.1109/ICST47872.2019.9166366.

22.

Wibisono,

M.T.

Anwar,

Supriyanto and

I.H.A.

Amin, Multivariate weather anomaly detection using DBSCAN clustering algorithm, Journal of Physics: Conference Series1869 (2021), 012077. IOP Publishing. doi:10.1088/1742-6596/1869/1/012077.

23.

M.Y.

Su, Real-time anomaly detection systems for denial-of-service attacks by weighted k-nearest-neighbor classifiers, Expert Systems with Applications38(4) (2011), 3492–3498. doi:10.1016/j.eswa.2010.08.137.

24.

Yu,

Jibin and

Jiang, An improved ARIMA-based traffic anomaly detection algorithm for wireless sensor networks, International Journal of Distributed Sensor Networks12(1) (2016), 9653230. doi:10.1155/2016/9653230.

25.

Liu,

Sun,

Han,

He,

Zhang and

Wu, Arrhythmia classification of LSTM autoencoder based on time series anomaly detection, Biomedical Signal Processing and Control71 (2022), 103228. doi:10.1016/j.bspc.2021.103228.

26.

Baek,

Oh,

C.Y.

Kim and

Lee, A model for detecting cryptocurrency transactions with discernible purpose, in: 2019 Eleventh International Conference on Ubiquitous and Future Networks (ICUFN), IEEE, 2019, pp. 713–717. doi:10.1109/ICUFN.2019.8806126.

27.

Himeur,

Ghanem,

Alsalemi,

Bensaali and

Amira, Artificial intelligence based anomaly detection of energy consumption in buildings: A review, current trends and new perspectives, Applied Energy287 (2021), 116601. doi:10.1016/j.apenergy.2021.116601.

28.

Riss,

Romano,

F.A.

Memon and

Kapelan, Detection of water quality failure events at treatment works using a hybrid two-stage method with CUSUM and random forest algorithms, Water Supply21(6) (2021), 3011–3026. doi:10.2166/ws.2021.062.

29.

Almuhtaram,

Zamyadi and

Hofmann, Machine learning for anomaly detection in cyanobacterial fluorescence signals, Water Research197 (2021), 117073. doi:10.1016/j.watres.2021.117073.

30.

A.S.

Qambar and

M.M.

Al Khalidy, Anomaly detection in wastewater treatment plants using unsupervised machine learning algorithms. Available at SSRN 4191844. doi:10.2139/ssrn.4191844.

31.

Nair,

Weitzel,

Hykkerud and

Ratnaweera, Supervised machine learning based system for automatic fault-detection in water-quality sensors, in: 2022 26th International Conference on System Theory, Control and Computing (ICSTCC), IEEE, 2022, pp. 64–67. doi:10.1109/ICSTCC55426.2022.9931788.

32.

Tang

et al., GRU-based interpretable multivariate time series anomaly detection in industrial control system, Computers & Security (2023), 103094. doi:10.1016/j.cose.2023.103094.

33.

Oliveira,

Fernandes,

Analide and

Novais, Forecasting energy consumption of wastewater treatment plants with a transfer learning approach for sustainable cities, Electronics10(10) (2021), 1149. doi:10.3390/electronics10101149.

34.

Chicco and

Jurman, The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation, BMC genomics21 (2020), 1–13. doi:10.1186/s12864-019-6413-7.

35.

Korkmaz, Deep learning-based imbalanced data classification for drug discovery, Journal of chemical information and modeling60(9) (2020), 4180–4190. doi:10.1021/acs.jcim.9b01162.

36.

Wegier and

Ksieniewicz, Application of imbalanced data classification quality metrics as weighting methods of the ensemble data stream classification algorithms, Entropy22(8) (2020), 849. doi:10.3390/e22080849.

37.

Tharwat, Classification assessment methods, Applied computing and informatics17(1) (2021), 168–192. doi:10.1016/j.aci.2018.08.003.

38.

Cheng,

Zou and

Dong, Outlier detection using isolation forest and local outlier factor, in: Proceedings of the Conference on Research in Adaptive and Convergent Systems, 2019, pp. 161–168. doi:10.1145/3338840.3355641.

39.

Smiti, A critical overview of outlier detection methods, Computer Science Review38 (2020), 100306. doi:10.1016/j.cosrev.2020.100306.

40.

Xu,

Zhang,

Li and

Zhu, Outlier detection algorithm based on k-nearest neighbors-local outlier factor, Journal of Algorithms & Computational Technology16 (2022), 17483026221078111. doi:10.1177/17483026221078111.

41.

F.T.

Liu,

K.M.

Ting and

Z.H.

Zhou, Isolation-based anomaly detection, ACM Transactions on Knowledge Discovery from Data (TKDD)6(1) (2012), 1–39. doi:10.1145/2133360.2133363.

42.

F.T.

Liu,

K.M.

Ting and

Z.H.

Zhou, 2008, Isolation forest, in: 2008 Eighth IEEE International Conference on Data Mining, IEEE, pp. 413–422. doi:10.1109/ICDM.2008.17.

43.

G.A.

Susto,

Beghi and

McLoone, Anomaly detection through on-line isolation forest: An application to plasma etching, in: 2017 28th Annual SEMI Advanced Semiconductor Manufacturing Conference (ASMC), IEEE, 2017, pp. 89–94. doi:10.1109/ASMC.2017.7969205.

44.

W.S.

Al Farizi,

Hidayah and

M.N.

Rizal, Isolation forest based anomaly detection: A systematic literature review, in: 2021 8th International Conference on Information Technology, Computer and Electrical Engineering (ICITACEE), IEEE, 2021, pp. 118–122. doi:10.1109/ICITACEE53184.2021.9617498.

45.

Ma,

Ghojogh,

M.N.

Samad,

Zheng and

Crowley, Isolation Mondrian forest for batch and online anomaly detection, in: 2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC), IEEE, 2020, pp. 3051–3058. doi:10.1109/SMC42975.2020.9283073.

46.

Gholami and

Fakhari, Support vector machine: Principles, parameters, and applications, in: Handbook of Neural Computation, Academic Press, 2017, pp. 515–535. doi:10.1016/B978-0-12-811318-9.00027-2.

47.

Al Amrani,

Lazaar and

K.E.

El Kadiri, Random forest and support vector machine based hybrid approach to sentiment analysis, Procedia Computer Science127 (2018), 511–520. doi:10.1016/j.procs.2018.01.150.

48.

Guo,

Liu,

Peng and

Peng, Data-driven anomaly detection using OCSVM with boundary optimzation, in: 2018 Prognostics and System Health Management Conference (PHM-Chongqing), IEEE, 2018, pp. 244–248. doi:10.1109/PHM-Chongqing.2018.00048.

49.

Alam,

S.K.

Sonbhadra,

Agarwal and

Nagabhushan, One-class support vector classifiers: A survey, Knowledge-Based Systems196 (2020), 105754. doi:10.1016/j.knosys.2020.105754.

50.

Ghafoori,

S.M.

Erfani,

Rajasegarar,

J.C.

Bezdek,

Karunasekera and

Leckie, Efficient unsupervised parameter estimation for one-class support vector machines, IEEE transactions on neural networks and learning systems29(10) (2018), 5057–5070. doi:10.1109/TNNLS.2017.2785792.

51.

Shravan Kumar and

Ravi, Text document classification with pca and one-class svm, in: Proceedings of the 5th International Conference on Frontiers in Intelligent Computing: Theory and Applications: FICTA 2016, Vol. 1, Springer, Singapore, 2017, pp. 107–115. doi:10.1007/978-981-10-3153-3_11.

52.

W.H.L.

Pinaya,

Vieira,

Garcia-Dias and

Mechelli, Autoencoders, in: Machine Learning, Academic Press, 2020, pp. 193–208. doi:10.1016/B978-0-12-815739-8.00011-0.

53.

Oliveira,

Fernandes,

Analide and

Novais, Multi-step ultraviolet index forecasting using long short-term memory networks, in: Distributed Computing and Artificial Intelligence, 17th International Conference, Springer International Publishing, 2021, pp. 187–197. doi:10.1007/978-3-030-53036-5_20.

54.

Zhang,

Liu,

Chen,

Shi,

Yao,

Yan and

Chen, Unsupervised anomaly detection based on deep autoencoding and clustering, Security and Communication Networks2021 (2021), 1–8. doi:10.1155/2021/7389943.

55.

I.T.

Nicholaus,

J.R.

Park,

Jung,

J.S.

Lee and

D.K.

Kang, Anomaly detection of water level using deep autoencoder, Sensors21(19) (2021), 6679. doi:10.3390/s21196679.