Despite decades of effort to improve information technology (IT) transition, the success rate remains low with each failure representing substantial losses of time, money, and resources. When technologies do transition, they often are ignored and worked around. Worse, they may disrupt work or interfere with work-system responses to challenges. We posit that a systems-centered approach to transition grounded in complex-systems science and resilience engineering can significantly improve technology adoption rates. To serve as the foundation for this approach, we developed a framework that specifies resilience characteristics of high-consequence work systems. The framework, called the Transform with Resilience during Upgrades to Socio-Technical Systems (TRUSTS) Framework, is the basis for IT development tools and guidance that enable resilience-aware development and transition. The tools and guidance will help development teams design and evaluate technologies that contribute to work system performance during escalated and nonroutine demands and conditions, i.e., to work system resilience.
Get full access to this article
View all access options for this article.
References
1.
AaronsonJ.MadhavanP.NevilleK.J.PattersonE.S.WilsonD.F. (2021). Modernize without compromise: Maintaining resilience and adaptivity in high-consequence healthcare operations, virtual panel discussion, December8, MITRE.
2.
BehutiyeW.N.RodríguezP.OivoM.TosunA.2017. Analyzing the concept of technical debt in the context of agile software development: A systematic literature review. Information and Software Technology, 82, 139–158.
3.
BahillA. T.GissingB. (1998). Re-evaluating systems engineering concepts using systems thinking. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 28(4), 516-527.
4.
BeedeE.BaylorE.HerschF.IurchenkoA.WilcoxL.RuamviboonsukP.VardoulakisL.2020. A Human-Centered Evaluation of a Deep Learning System Deployed in Clinics for the Detection of Diabetic Retinopathy. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Apr 25-30, Honolulu, HI.
5.
BigleyG. A.RobertsK. H. (2001). The incident command system: High-reliability organizing for complex and volatile task environments. Academy of Management Journal, 44(6), 1281-1299.
6.
ChenD.NevilleK.J.MasseyL.BurbeloG.A.BlankenbecklerP.N.NormandS.UhlE. (2019). Toward a definition of complex cognitive skill. Proceedings of the 2019 Annual Meeting of the Human Factors and Ergonomics Society. Thousand Oaks, CA: Sage.
7.
CodabuxZ.WilliamsB. (2013). Managing technical debt: An industrial case study. 4th International Workshop on Managing Technical Debt (MTD), 8–15.
8.
Cunningham W. (1992). The WyCash Portfolio Management System. OOPSLA’92 Object Oriented Programming Systems, Languages and Applications, Vancouver, B.C., Canada, October18-22. NY: ACM, 29-30. doi: 10.1145/157710.157715.
9.
DortonS.L.HarperS.B. (2022). A naturalistic investigation of trust, AI, and intelligence work. Journal of Cognitive Engineering and Decision Making. doi: 10.1177/15553434221103718
10.
DwivediY. K.WastellD.HenriksenH. Z. (2015). Guest editorial: Grand successes and failures in IT:Private and public sectors. Information Systems Frontiers, 17, 11-14.
11.
HollnagelE. (2009). The four cornerstones of resilience engineering. In HollnagelE.DekkerS. (Eds.), Resilience engineering perspectives:Vol. 2. Preparation and restoration (pp. 117–133). Farnham, UK: Ashgate.
12.
KheybariS.RezaieF. M.NajiS. A.JavdanmehrM.RezaeiJ. (2020). Evaluation of factors contributing to the failure of information systems in public universities: The case of Iran. Information Systems, 92, 101534.
13.
KleinG. (2007). Flexecution as a paradigm for replanning, part 1. IEEE Intelligent Systems, 22(5), 79-83.
14.
KleinG.MoonB.HoffmanR. R. (2006). Making sense of sensemaking 2: A macrocognitive model. IEEE Intelligent systems, 21(5), 88-92.
15.
LipshitzR.StraussO. (1997). Coping with uncertainty: A naturalistic decision-making analysis. Organizational behavior and human decision processes, 69(2), 149-163.
16.
MadniA.M.JacksonS.E. (2009). Towards a conceptual framework for resilience engineering. IEEE Systems Journal, 3(2), 181-191.
17.
Marketplace. (1997, Jan). Marketplace for January 31st, 1997. NPR.
PattersonE. S.MilitelloL. G.SuG.SarkarU. (2016). Characterizing a naturalistic decision-making phenomenon: loss of system resilience associated with implementation of new technology. Journal of cognitive engineering and decision making, 10(3), 229-243.
20.
FinkelsteinA.DowellJ. (1996, March). A comedy of errors: the London Ambulance Service case study. In Proceedings of the 8th International Workshop on Software Specification and Design (pp. 2-4). IEEE.
21.
FlachJ. M.FeufelM. A.ReynoldsP. L.ParkerS. H.KelloggK. M. (2017). Decision making in practice: The dynamics of muddling through.Applied Ergonomics,63, 133-141.
22.
FlachJ. M.Steele-JohnsonD.ShalinV. L.HamiltonG. C. (2013). Coordination and control in emergency response. Handbook of Emergency Response: A Human Factors and Systems Engineering Approach, 533-548.
23.
GaikemaM.DonkerslootM.JohnsonJ.MulderH. (2019). Increase the success of Governmental IT-projects. Systemics, Cybernetics and Informatics, 17(1), 97-105.
24.
HoffmanR.R. (2021). Designer-Centered Design in the Field of Artificial Intelligence: AI as a Workforce Issue, October. Institute for Human-Machine Cognition. https://www.ihmc.us/wp-content/uploads/2021/10/.
25.
HoffmanR.R.KleinG.WoodsD.D. (2019). The theoretical foundation of macrocognition. Proceedings of the International Conference on Naturalistic Decision Making 2019, July16-20, San Francisco, CA.
26.
Roux-DufortC.VidailletB. (2003). The difficulties of improvising in a crisis situation. International Studies of Management and Organization, 3 (1), 86–115.
27.
SageA. P.CuppanC. D. (2001). On the systems engineering and management of systems of systems and federations of systems. Information, Knowledge Systems Management, 2(4), 245–325. IOS Press.
28.
SherwoodS.MNevilleK.J.McLeanA.L.M.T.WalwanisM.M.BoltonA. (2020). Integrating new Technology into the complex system of air combat training. In HandleyH.TolkA. (Eds.), A framework of Human System Engineering: Applications and case studies. Washington, D.C.: IEEE.
29.
SmithP. J.SpencerA. L.BillingsC. E. (2007). Strategies for designing distributed systems: case studies in the design of an air traffic management system. Cognition, Technology & Work, 9(1), 39-49.
30.
SnowdenD. J.BooneM. E. (2007). A leader’s framework for decision making. Harvard business review, 85(11), 68-77.
31.
StephensR. J.WoodsD. D.BranlatM.WearsR. L. (2011, June). Colliding dilemmas: Interactions of locally adaptive strategies in a hospital setting. Paper presented at the Fourth International Symposium on Resilience Engineering, Sophia Antipolis, France.
32.
SaurinT. A.WerleN. J. B. (2017). A framework for the analysis of slack in sociotechnical systems. Reliability Engineering & System Safety, 167, 439-451.
33.
StephensR. J.WoodsD. D.BranlatM.WearsR. L.(2011b). Colliding Dilemmas: Interactions of Locally Adaptive Strategies in a Hospital Setting. Proceedings of the Fourth Resilience Engineering Symposium (pp. 256262), June8-10, 2011, Sophia-Antipolis, France.
34.
VarajãoJ.TrigoA.PereiraJ. L.MouraI. (2021). Information systems project management success. International Journal of Information Systems and Project Management, 9(4), 62-74.
35.
WoodsD. D. (2019). Essentials of resilience, revisited. In RuthM.ReisemannS. G. (Eds.), Handbook on resilience of sociotechnical systems. Cheltenham, UK: Edward El-gar.
36.
WoodsD. D. (2018). The theory of graceful extensibility: basic rules that govern adaptive systems. Environment Systems and Decisions, 38(4), 433-457
37.
WoodsD.D. (2017). STELLA:Report from the SNA-FUcatchers Workshop on Coping With Complexity. Columbus, OH: The Ohio State University.
38.
WoodsD. D. (2015). Four concepts for resilience and the implications for the future of resilience engineering. Reliability Engineering & System Safety, 141, 5-9.
39.
WoodsD. D. (2006). Essential characteristics of resilience. In. HollnagelE.WoodsD. D.LevesonN. (Eds.), Resilience Engineering: Concepts and Precepts (pp. 21-34). Ashgate.
