Do machine learning methods used in data mining enhance the potential of decision support systems? A review for the urban water sector

Abstract

With sustainable development as their overarching goal, Urban Water System (UWS) managers need to take into account all social, economic, technical and environmental facets related to their decisions. Decision support systems (DSS) have been used widely for handling such complexity in water treatment, having a high level of popularity as academic exercises, although little validation and few full-scale implementations reported in practice. The objective of this paper is to review the application of artificial intelligence methods (mainly machine learning) to UWS and to investigate the integration of these methods into DSS. The results of the review suggest that artificial neural networks is the most popular method in the water and wastewater sectors followed by clustering. Bayesian networks and swarm intelligence/optimization have shown a spectacular increase in the water sector in the last 10 years, being the latest techniques to be incorporated but overtaking case-based reasoning. Whereas artificial intelligence applications to the water sector focus on modelling, optimization or data mining for knowledge generation, their encapsulation into functional DSS is not fully explored. Few academic applications have made it into decision making practice. We believe that the reason behind this misuse is not related to the methods themselves but rather to the disassociation between the fields of water and computer engineering, the limited practical experience of academics, and the great complexity inherently present.

Keywords

AI decision support review urban water system

Get full access to this article

View all access options for this article.

References

Adeli, Neural networks in civil engineering: 1989–2000, Computer-Aided Civil and Infrastructure Engineering16 (2001), 126–142. doi:10.1111/0885-9507.00219.

Borowski and

Hare, Exploring the gap between water managers and researchers: Difficulties of model-based tools to support practical water management, Water Resour Manage21 (2006), 1049–1074. doi:10.1007/s11269-006-9098-z.

M.E.

Borsuk,

C.A.

Stow and

K.H.

Reckhow, A Bayesian network of eutrophication models for synthesis, prediction, and uncertainty analysis, Ecol. Modell.173 (2004), 219–239. doi:10.1016/j.ecolmodel.2003.08.020.

B.R.

Bradley,

G.T.

Daigger,

Rubin and

Tchobanoglous, Evaluation of onsite wastewater treatment technologies using sustainable development criteria, Clean Techn Environ Policy4 (2002), 87–99. doi:10.1007/s10098-001-0130-y.

P.R.

Brandon, Stakeholder participation for the purpose of helping ensure evaluation validity: Bridging the gap between collaborative and non-collaborative evaluations, American Journal of Evaluation19 (1998), 325–337. doi:10.1177/109821409801900305.

Brown, The end of reliability, Journal of Water Resources Planning and Management136 (2010), 143–145. doi:10.1061/(ASCE)WR.1943-5452.65.

Cain, Planning Improvements in Natural Resources Management: Guidelines for Using Bayesian Networks to Support the Planning and Management of Development Programmes in the Water Sector and Beyond, Cent. Ecol. Hydrol., Wallingford, Oxon., UK, 2001, pp. 1–124.

Chau, A review on integration of artificial intelligence into water quality modelling, Marine Pollution Bulletin52 (2006), 726–733. doi:10.1016/j.marpolbul.2006.04.003.

Cortés,

Sànchez-Marrè,

Ceccaroni,

R-Roda and

Poch, Artificial intelligence and environmental decision support systems, Applied Intelligence13 (2000), 77–91. doi:10.1023/A:1008331413864.

10.

G.T.

Daigger, Wastewater management in the 21st century, Journal of Environmental Engineering133 (2007), 671–680. doi:10.1061/(ASCE)0733-9372(2007)133:7(671).

11.

G.T.

Daigger and

G.V.

Crawford, Wastewater treatment plant of the future-decision analysis approach for increased sustainability, in: 2nd IWA Leading-Edge Conference on Water and Wastewater Treatment Technology, Water and Environment Management Series, IWA Publishing, 2004, pp. 361–369.

12.

Dominguez and

Gujer, Evolution of a wastewater treatment plant challenges traditional design concepts, Water Res.40 (2006), 1389–1396. doi:10.1016/j.watres.2006.01.034.

13.

C.B.S.

Dotto,

Mannina,

Kleidorfer,

Vezzaro,

Henrichs,

D.T.

McCarthy,

Freni,

Rauch and

Deletic, Comparison of different uncertainty techniques in urban stormwater quantity and quality modelling, Water Res.46 (2012), 2545–2558. doi:10.1016/j.watres.2012.02.009.

14.

European Council, Directive 2000/60/EC of the European Parliament and of the Council of 23 October 2000 establishing a framework for Community action in the field of water policy, 2000.

15.

Garrido-Baserba, Development of an environmental decision support system for the selection and integrated assessment of process flow diagrams in wastewater treatment, Universitat de Girona, Institut de Medi Ambient, 2013.

16.

K.V.

Gernaey,

M.C.M.

Van Loosdrech,

Henze,

Lind and

S.B.

Jørgensen, Activated sludge wastewater treatment plant modelling and simulation: State of the art, Environ. Model. Softw.19 (2004), 763–783. doi:10.1016/j.envsoft.2003.03.005.

17.

Gibert and

Sànchez-Marrè, A Picture on Environmental Data Mining Real Applications. What Is Done and How?International Environmental Modelling and Software Society (iEMSs), 2012.

18.

Gibert and

Sànchez-Marrè, Improving ontological knowledge with reinforcement in recommending the data mining method for real problems, in: Proceedings of Conferencia de la Asociación Española Para la Inteligencia Artificial (CAEPIA), TAMIDA, 2015, pp. 769–778.

19.

Gibert,

Sànchez-Marrè and

Codina, Choosing the right data mining technique: Classification of methods and intelligent recommenders, in: Proceedings of the IEMSs Firth Biennial Meeting: Int’l Congress on Environmental Modelling and Software, Vol. I, Ottawa University, 2010, pp. 978–988.

20.

Guariso and

Werthner, Environmental Decision Support Systems, Ellis Horwood Ltd., Chichester England, New York, 1989.

21.

H.J.

Henriksen,

Rasmussen,

Brandt,

von Bülow and

F.V.

Jensen, Public participation modelling using Bayesian networks in management of groundwater contamination, Environ. Model. Softw.22 (2007), 1101–1113. doi:10.1016/j.envsoft.2006.01.008.

22.

Herrfahrdt-Pähle, Integrated and adaptive governance of water resources: The case of South Africa, Reg Environ Change13 (2013), 551–561. doi:10.1007/s10113-012-0322-5.

23.

J.A.E.B.

Janssen,

A.Y.

Hoekstra,

J.-L.

de Kok and

R.M.J.

Schielen, Delineating the model-stakeholder gap: Framing perceptions to analyse the information requirement in river management, Water Resour Manage23 (2008), 1423–1445. doi:10.1007/s11269-008-9334-9.

24.

Jin,

C.Y.

Xu,

Zhang and

V.P.

Singh, Parameter and modeling uncertainty simulated by GLUE and a formal Bayesian method for a conceptual hydrological model, J. Hydrol.383 (2010), 147–155. doi:10.1016/j.jhydrol.2009.12.028.

25.

Kashyap, Water governance: Learning by developing adaptive capacity to incorporate climate variability and change, Water Science and Technology49 (2004), 141–146.

26.

Li,

H.Z.

Yang and

X.F.

Liang, Prediction analysis of a wastewater treatment system using a Bayesian network, Environ. Model. Softw.40 (2013), 140–150. doi:10.1016/j.envsoft.2012.08.011.

27.

Liu,

Mooney,

Hull,

Davis,

Gaskell,

Hertel,

Lubchenco,

Seto,

Gleick,

Kremen and

Li, Systems integration for global sustainability, Science347(6225) (2015), 963–972. doi:10.1126/science.1258832.

28.

B.S.

McIntosh,

J.C.

AscoughII.,

Twery,

Chew,

Elmahdi,

Haase,

J.J.

Harou,

Hepting,

Cuddy,

A.J.

Jakeman,

Chen,

Kassahun,

Lautenbach,

Matthews,

Merritt,

N.W.T.

Quinn,

Rodriguez-Roda,

Sieber,

Stavenga,

Sulis,

Ticehurst,

Volk,

Wrobel,

van Delden,

El-Sawah,

Rizzoli and

Voinov, Environmental decision support systems (EDSS) development – Challenges and best practices, Environ. Model. Softw.26 (2011), 1389–1402. doi:10.1016/j.envsoft.2011.09.009.

29.

P.C.D.

Milly,

Betancourt,

Falkenmark,

R.M.

Hirsch,

Z.W.

Kundzewicz,

D.P.

Lettenmaier and

R.J.

Stouffer, Stationarity is dead: Whither water management?, Science319 (2008), 573–574. doi:10.1126/science.1151915.

30.

M.B.

Neumann,

Rieckermann,

Hug and

Gujer, Adaptation in hindsight: Dynamics and drivers shaping urban wastewater systems, Journal of Environmental Management151 (2015), 404–415. doi:10.1016/j.jenvman.2014.12.047.

31.

OECD, Social Issues in the Provision and Pricing of Water Services, OECD Publishing, 2003.

32.

OECD, Cost-Benefit Analysis and the Environment, Organisation for Economic Co-operation and Development, Paris, 2006.

33.

OECD, Pricing Water Resources and Water and Sanitation Services, Organisation for Economic Co-operation and Development, Paris, 2010.

34.

OECD, Water Governance in the Netherlands, Organisation for Economic Co-operation and Development, Paris, 2014.

35.

Pahl-Wostl,

Kabat and

Möltgen (eds), Adaptive and Integrated Water Management, Springer, Berlin Heidelberg, 2008.

36.

Pahl-Wostl,

Sendzimir,

Jeffrey,

Aerts,

Berkamp and

Cross, Managing change toward adaptive water management through social learning, Ecology and Society12(2) (2007), art. 30.

37.

Poch,

Comas,

Rodríguez-Roda,

Sànchez-Marrè and

Cortés, Designing and building real environmental decision support systems, Environmental Modelling & Software19 (2004), 857–873. doi:10.1016/j.envsoft.2003.03.007.

38.

Poch,

Cortés,

Comas Matas and

Rodríguez-Roda Layret and

Sànchez i Marrè, eds, Decisions on Urban Water Systems: Some Support, University of Girona, 2012.

39.

Polasky,

S.R.

Carpenter,

Folke and

Keeler, Decision-making under great uncertainty: Environmental management in an era of global change, Trends in Ecology & Evolution26 (2011), 398–404. doi:10.1016/j.tree.2011.04.007.

40.

Rauch and

Kleidorfer, Replace contamination, not the pipes, Science345 (2014), 734–735. doi:10.1126/science.1257988.

41.

A.E.

Rizzoli and

W.J.

Young, Delivering environmental decision support systems: Software tools and techniques, Environ. Model. Softw.12 (1997), 237–249. doi:10.1016/S1364-8152(97)00016-9.

42.

Sedlak, Water 4.0: The Past, Present, and Future of the World’s Most Vital Resource, Yale University Press, 2014.

43.

Uusitalo, Advantages and challenges of Bayesian networks in environmental modelling, Ecol. Modell.203 (2007), 312–318. doi:10.1016/j.ecolmodel.2006.11.033.

44.

M.C.

van Loosdrecht and

Brdjanovic, Anticipating the next century of wastewater treatment, Science344 (2014), 1452–1453. doi:10.1126/science.1255183.

45.

W.E.

Walker,

Harremoës,

Rotmans,

J.P.

van der Sluijs,

M.B.A.

van Asselt,

Janssen and

M.P.

Krayer von Krauss, Defining uncertainty: A conceptual basis for uncertainty management in model-based decision support, Integrated Assessment4 (2003), 5–17. doi:10.1076/iaij.4.1.5.16466.