The Selection of Main Surgical Work Factors in Operating Rooms

Abstract

The main component of error minimization in operating rooms (ORs) is to maintain high reliability of surgical teams. The analysis of adverse events in the OR reveals deficiencies in cognitive and interpersonal skills as the main factors influencing surgeons’ errors. Therefore, research of these additional factors is necessary, besides factors related to surgeons’ clinical knowledge and technical skills. In this paper, the key factors for evaluating activities in surgical operating rooms are identified. Fuzzy analytic hierarchy process is used for identification of key factors. Fifteen key factors are identified for evaluating activities in surgical operating rooms to improve the efficiency of surgical operations. For each group of activities (surgical “capabilities,” operating room characteristics, and non-technical skills), five factors are identified. As the most important, the following factors are obtained: communication, indoor environment standardization, and tool handle design. The aim of the analysis of these key factors is surgeons’ work capability enhancement, rational design of operating rooms, and advancement of operators’ cognitive and interpersonal skills.

Keywords

surgical operating room surgeons’ capabilities non-technical skills activities fuzzy analytic hierarchy process

What we already know about this topic?

The analysis of adverse events in healthcare leads to the conclusion that most of them are not the consequence of inadequate use of technical skills or insufficient clinical knowledge of surgeons but not applying an ergonomic approach in designing space, devices, conditions, and interrelationships in the ORs.

How does your research contribute to the field?

The research defined in this paper opens new research field related to the improvement of cognitive and social skills of surgeons, as well as the improvement of their coordination, communication, and leadership during teamwork.

What are your research’s implications toward theory, practice, or policy?

The contribution of this research is the formation of new methodological approach that leads to increased efficiency of operators in the OR and new quantitative method for research, the efficiency of teamwork in the OR, as well as possibility of applying the results of this research in a large number of medical institutions.

Introduction

The extent of ergonomic research on practical surgical activity in operating rooms (ORs) has improved significantly over the years, but the results of these studies are still insufficiently used.¹ The OR design requires multidisciplinary collaboration of experts, who use their expertise to achieve a common goal, which is designing a more efficient and more functional OR.² The OR environment consists of physical space, which has significant deficiencies,^3,4 as well as equipment and people (medical staff and patients).

Surgical procedures are different types of interventions performed in operating rooms using instruments (tools). Various adverse events may occur during surgery. The causes of these events are various, and the hints are not predictable in advance. The analysis of risk events in healthcare leads to the conclusion that many causes of these events are of non-technical nature,^5,6 such as communication,^7,8 cooperation, coordination, and leadership.⁹

Communication problems can affect safety and lead to injury of surgical patients.¹⁰ In complex surgical procedures, teamwork, and coordination and communication skills are the essence of successful work.^11,12 Greenberg et al. point out that the most common problems occur in the simplest communication pattern, verbal communication between the two people in the OR.¹³ Burgener emphasize the importance of effective communication and teamwork in patient care, which is even more important during surgical interventions.¹⁴ Communication problems can cause different types of adverse effects. Ineffective communication is the cause of numerous problems during surgical operations.¹⁵

Stress can also affect surgeon’s performance. Certain level of improvement in performance under stress has been detected.^16,17 The causes of stress may be technical flaws in the OR, time pressure, distractions, interruptions, or increased workload.^18,19 In order to ensure the safety of patients undergoing surgical procedures, it is important that surgeons possess high mental judgment ability in the OR.^20,21

Some operations are performed manually, using special tools that allow cutting and extraction, retraction, and sealing (closing the wound). Therefore, hand tool ergonomics is very important when considering activities in the operating room. Studies have shown that there are no significant differences in hand dexterity between medical students and other people, despite their commitment to surgery.²² Others reveal decrease in hand dexterity over time.^22,23

Standardization in the field of operating environment and equipment is a significant factor that affects quality of team work in the OR. Poor ventilation and increased temperature can lead to work-related errors, and the risk of infection increases.^24-26 Inadequate noise, illumination, humidity, and temperature levels can negatively affect surgeons’ activity in the OR and patient’s safety.²⁷ Survey of surgical checklists and analysis after their application show that their introduction reduces mortality and morbidity in surgery.^28-32

The analysis of literature showed that there is a lot of research on operative approaches of surgeons, their expert knowledge and abilities (sensory-motor capabilities and situational awareness), their workload (mental and physical) and workload-caused vulnerability (musculoskeletal disorders and hand dexterity).

However, research attention has not been focused on the ergonomic aspects in the design of ORs and working equipment (operating table and hand tools), the impact of working environment conditions on the work of surgeons (microclimate and noise), and importance of surgeons’ non-technical skills (group work, communication, cooperation, coordination and leadership, stress, and use of checklists).

Therefore, a new research procedure with the goal to improve surgeons’ working capacity, achieve more humane and rational design of ORs and devices, and improve surgeons’ cognitive and interpersonal skills is needed. It consists of systematic sequence of logically connected research activities, as shown in the following text.

Method

The analysis of factors affecting work efficiency in complex working environments and activities in such environments does not give a complete picture of the problem itself. An integrated and synergistic approach, taking into consideration a number of factors, leads to a more complete analysis of the problem. This approach is applied during the research presented in this paper.

For the purpose of ranking the key factors for activity assessment in surgical operating rooms, it is necessary to determine the most important factors and classify them into appropriate groups. Based on the analysis of the existing literature and previous analyses of different impacts of a working environment,^33,34 fifteen key factors are identified and grouped into three major categories: surgeons’ capabilities, operating room properties, and non-technical skills.

The following methods were used for the analysis of selected factors:

• Surgeons’ capabilities: Motor-sensor - response matrices; Mental workload - SWAT (Subjective Workload Assessment Technique); Situational awareness - CARS (Crew Awareness Rating Scale); Musculoskeletal disorders - OWAS (Ovako Working Posture Assessment System); and Hand dexterity - Manual dexterity aptitude test.

• Operating room: Operating room design - ISO 11064 standard for control room ergonomics and simulation of Digital Human Models (DHM); Indoor environmental quality - standards defining measurement methods and application procedures for specific measurements, as well as ISO 14000 for environmental management and ISO 45000 for occupational safety; Visualization - Illuminance recommendations for ORs; Noise levels - Serbian national standard SRPS ISO 1996-1: 2019; and Tool handle design - scale for Local Perceived Discomfort (LPD).

• Non-technical skills: Teamwork - Observational Teamwork Assessment for Surgery (OTAS); Leadership - The Oxford NOTECHS System; Communication efficiency - graphs and matrices (scope of communication, team connection, workload balance, and workplace isolation); Stress - Workplace stress scale (WSS); and Surgical safety checklist - WHO surgical safety checklist.

The main drawback of using a lot of factors is that all groups of factors and all factors do not have equal impact on the problem under consideration. The effect of certain factors has a more significant impact on surgeons' activities. That is the reason for the application of the group and factor ranking method, and the involvement of more experts in decision-making.

It is recommended to use the multi-criteria analysis method to determine the key factors of a complex problem. Based on the method presented in the aforementioned research,³³ for simpler understanding of the decision-making process and more accurate ranking results, the following factors are used: fuzzy numbers, analytic hierarchy process, and group decision-making.

The applied group fuzzy analytic hierarchy process consists of the following steps: (1) identifying the experts and assigning significance describing their influence on the final decision based on the level of experience; (2) creation of hierarchical structure of factors and groups of factors; (3) pairwise comparison groups and individual factors based on the proposed hierarchical structure using fuzzy numbers; (4) determining the aggregate patterns based on the comparison of individual experts and their roles describing their influence on the final decision; (5) determining fuzzy significance for groups of factors and individual factors based on obtained aggregate fuzzy patterns; (6) defuzzification (determination of crisp numbers based on fuzzy numbers), and ranking based on the obtained results.

Ranking determines the significance of individual factors and groups of factors for the purpose of using them in further analyses. The weights of individual experts are defined by gamma coefficient.³³ Based on the experience of an individual expert in the analysis of activity in the operating rooms (denoted by b_k) and experience in the analysis of activities in operating rooms adapted to certain types of operations (denoted by c_k), the value of γ_k is determined. The scale for describing experience is 1 to 5. Based on Eq. (5),³³ a weight vector of experts Γ is obtained: Γ={0.09,0.13,0.09,0.19,0.13,0.13,0.09,0.06,0.06,0.04}.

On the basis of row geometric mean method (RGMM), aggregated matrices are determined. The consistency of individual expert comparison is verified using consistency index (CI), while the consistency of group decision-making is determined by centric consistency index (CCI).³⁵ Defuzzification is obtained using the mean aggregated weight method.

Results

During the analysis of surgical room activities at the Vascular Surgery Clinic, Clinical Center in Nis, hierarchy of factors is created (Figure 1). This hierarchy is used in the group ranking, involving 10 experts from different fields (ergonomics, medicine, information processing, and safety) by means of fuzzy AHP.

Figure 1.

Hierarchical structure of factors. Note: There are three groups of factors. The first group describes surgeons’ capabilities: mental and physical workload (S₁), sensory-motor capabilities (S₂), situational awareness (S₃), musculoskeletal disorders (S₄), and hand dexterity (S₅). The second group describes operating room properties affecting the work efficiency: operating room design (O₁), indoor environment standardization (O₂), visualization (O₃), noise (O₄), and tool handle design (O₅). The third group describes non-technical skills: teamwork (N₁), leadership (N₂), communication (N₃), surgical safety checklist (N₄), and stress (N₅).

The expert group was composed of six surgeons from the Clinical Center Nis (endocrine surgeon, two orthopedic surgeons, two vascular surgeons, and neurosurgeon), one ergonomics expert, one safety expert, one mathematician, and one computer scientist. At the panel discussion, experts analyzed research goals, relevant literature data on this topic, and expectations of the authors. Based on the panel discussion, the authors formed a questionnaire with thirty potential factors, of which experts identified fifteen key factors. The analysis of completed questionnaires, with the consent of all experts, identified fifteen key factors.

Experts estimate activities using triangular fuzzy numbers and the following values of the fuzzified Saaty’s scale: identical (1,1,1), equally significant (1,1,3), more significant (1,3,5), much more significant (3,5,7), markedly more significant (5,7,9), and dominant (7,9,9). The factors are compared in groups, and pairwise comparison matrices are formed.

The aggregated matrix based on the comparison of criteria groups in relation to the goal is presented in Table 1.

Table 1.

The Aggregated Matrix for Groups of Factors.

	S	O	N	Crisp weight
S	(1,1,1)	(.41,0.68,1.32)	(.42,0.78,1.42)	.272
O	(.76,1.48,2.42)	(1,1,1)	(.62,1.01,1.97)	.376
N	(.7,1.29,2.41)	(.51,0.99,1.63)	(1,1,1)	.352
CCI= .02

The aggregated matrix based on the comparison of factors in relation to individual groups of factors (surgeons’ capabilities S; operating room properties O; and non-technical skills N) is presented in Table 2. The CCI values for aggregated matrices, describing the consistency, are also presented.

Table 2.

The Aggregated Matrix for Factors in Relation to Surgeons’ Capabilities (Group S), Operating Room Properties (Group O), as well as Non-technical Skills (Group N).

CCI_S=.01	S ₁	S ₂	s ₃	s ₄	S ₅
S ₁	(1,1,1)	(.38,0.55,1.29)	(.42,0.92,1.26)	(.76,1.05,2.27)	(.35,0.65,1)
S ₂	(.77,1.8,2.64)	(1,1,1)	(.81,1.6,2.77)	(1,1.69,3.2)	(.56,1.1,1.79)
S ₃	(.79,1.09,2.37)	(.36,0.62,1.23)	(1,1,1)	(.87,1.27,2.61)	(.45,0.79,1.41)
S ₄	(.44,0.96,1.32)	(.31,0.59,1)	(.38,0.79,1.15)	(1,1,1)	(.38,0.6,1.23)
S ₅	(1,1.53,2.89)	(.56,0.91,1.79)	(.71,1.26,2.24)	(.81,1.67,2.63)	(1,1,1)
CCI_O=.01	O ₁	O ₂	o ₃	o ₄	O ₅
O ₁	(1,1,1)	(.56,0.69,1.75)	(.5,1.13,1.55)	(.57,1.03,1.71)	(.5,0.93,1.73)
O ₂	(.57,1.45,1.79)	(1,1,1)	(.67,1.16,2)	(.64,1.22,2.01)	(.6,1.19,1.79)
O ₃	(.64,0.88,2.02)	(.5,0.86,1.49)	(1,1,1)	(.63,0.95,1.97)	(.58,0.77,1.65)
O ₄	(.58,0.97,1.75)	(.5,0.82,1.56)	(.51,1.05,1.59)	(1,1,1)	(.5,0.88,1.67)
O ₅	(.58,1.08,2)	(.56,0.84,1.67)	(.61,1.29,1.74)	(.6,1.14,2)	(1,1,1)
CCI_N=.01	N ₁	N ₂	N ₃	N ₄	N ₅
N ₁	(1,1,1)	(.87,1.31,2.68)	(.44,0.67,1.42)	(.61,1.15,1.96)	(.48,1.01,1.55)
N ₂	(.37,0.76,1.15)	(1,1,1)	(.35,0.59,1.15)	(.52,0.87,1.67)	(.35,0.76,1.02)
N ₃	(.71,1.49,2.3)	(.87,1.7,2.82)	(1,1,1)	(.87,1.71,3.22)	(.72,1.34,2.51)
N ₄	(.51,0.87,1.63)	(.6,1.15,1.91)	(.31,0.58,1.15)	(1,1,1)	(.45,0.88,1.55)
N ₅	(.64,0.99,2.06)	(.98,1.32,2.88)	(.4,0.75,1.38)	(.64,1.14,2.2)	(1,1,1)

Local weights and rankings relative to groups of factors, as well as final weights and ranks, are shown in Table 3.

Table 3.

The Ranking of Key Factors in the Analysis of Surgical Room Activities.

	Factors	Local weight	Local rank	Final weight	Final rank
S ₁	Mental and physical workload	.160	4	.0434	14
S ₂	Sensory-motor capabilities	.262	1	.0712	7
S ₃	Situational awareness	.193	3	.0526	12
S ₄	Musculoskeletal disorders	.142	5	.0387	15
S ₅	Hand dexterity	.243	2	.0662	10
O ₁	Operating room design	.191	4	.0717	6
O ₂	Indoor environment standardization	.219	1	.0822	2
O ₃	Visualization	.195	3	.0731	5
O ₄	Noise	.188	5	.0706	8
O ₅	Tool handle design	.208	2	.0781	3
N ₁	Teamwork	.199	3	.0700	9
N ₂	Leadership	.146	5	.0516	13
N ₃	Communication	.270	1	.0953	1
N ₄	Surgical safety checklist	.171	4	.0603	11
N ₅	Stress	.213	2	.0751	4

At the Vascular Surgery Clinic, Clinical Center in Nis, Serbia (Figure 2), a communication efficiency investigation was conducted for groups of three and four surgeons (Figure 3), using graphs and forms. Evaluations of these investigations are presented in quantitative form.³⁴

Figure 2.

Operating room in the vascular surgery clinic, clinical center in Nis.

Figure 3.

Communication scheme between three (a) and four (b) surgeons in operating room.

Discussion

The expert team applied this new synergistic methodological approach to ergonomic research in surgery during the analysis of surgeons’ activities from vascular, orthopedic, and neurosurgical clinics of the Clinical Center in Nis, in cooperation with experts in ergonomics, computer engineering, and safety.

Experts from different fields of research compare factors for activity analysis with more precision when using linguistic variables. Fuzzy numbers allow describing particular linguistic variables using a set of values from a certain range. Group decision-making reduces the subjectivity of the decisions of individual experts. A selection of appropriate experts (information processing, ergonomics, safety, and medicine) allows better problem assessment.

Based on the results of final ranking, shown in Table 3, the following can be concluded: the highest ranked group of factors is “Operating room properties” (O), followed by “Non-technical skills” (N), and “Surgeons’ capabilities” (S). Among the factors, the highest ranked factors belong to groups Operating room properties (O) and Non-technical skills (N). Among them, the most important is Communication.

Failures in the transmission of information and communication are common in surgical practice. Therefore, a review of published literature data is performed using Medline, Embase, PsycINFO, ScienceDirect, and interviews with surgical team members.

Different communication patterns are identified in surgical teams.^36,37 Information transfer can be different in manner and tension level among team members. The way of information transfer is defined by the number of team members, communication channels, team members and their roles, and events during surgical operations (normal or emergency activities). Communication before operation can be very helpful in avoiding errors during operations. Many authors emphasize that the lack of communication before operation and ineffective communication during operation are the most important causes of errors during surgical operations. Therefore, the research on efficient communication patterns during surgical operations is important because these patterns enable the formation of standardized communication, through checklists, forms, and technological innovation, which improves the quality of transmission and communication in surgical operating rooms.

Lingard et al. identified the following key factors causing problems during communication in the OR: problems with timing; insufficient or inadequate information; unidentified goals; inadequate group composition causing decreased collaboration; and communication tension.¹⁵

Team performance in surgery is increasingly seen as crucial for safety. Through the analysis of data, three themes are created that illustrate communication culture of team work in surgery: “building shared understandings through open communication,” “managing contextual stressors in a hierarchical environment,” and “intermittent membership influences team performance.”³⁸ In creating a security culture in a health organization, the optimal results of the team rely on open discussion on team work and team expectations, and significantly depend on how organizational culture promotes such discussion.

Inadequate communication and team factors are the main causes of errors during surgical operations.^15,39,40 The development of different methodological approaches in recent years has significantly improved research on communication in teamwork in healthcare. These studies are supported by studies that investigate causes of adverse events and impact of better communication of team work on the prevention of these events, quality of communication by health service providers, and various forms of communication, coordination, and leadership that support effective teamwork.⁴¹

The experts emphasized the importance of effective communication and coordination of activities during the surgical operations, helping surgeons during effective performing of tasks, activity coordination, and performing activities during adverse events in the OR.

The significance of the research of ergonomic aspects in surgical activities consists of the definition of approach describing the improvement of surgeons’ capabilities. It also leads to improvement of surgeons’ non-technical skills, more humane OR design, quantification of communication efficiency, and overall OR team work efficiency. However, there are some limitations for this study. First, the anthropometric research methods determining the dimensions of the surgeon’s body and body parts were not applied. The anthropometric dimensions significantly affect ergonomic design of the equipment in the OR. Second, the research should be additionally supported by biomechanical-kinesiological research methods to analyze movements of the surgeon’s hands during surgical procedures and determine maximum force. The reliability of the surgeon’s should be also analyzed, that is, errors during the work, to reduce their number, and the consequences. Future research should be based on the development of new valid research tools that quantify research results to support descriptive explanations.

Conclusion

Significant numbers of adverse events in surgical practice occur due to non-application of research approaches related to surgeons’ capabilities, operating room properties, and non-technical skills, and not due to essential requirements in surgery related to application of clinical knowledge and surgeon’s technical skills. Therefore, it is necessary to supplement knowledge with research and identify other causes of adverse events in ORs.

In this paper, the expert team ranked 15 factors representing the causes that affect surgeons’ efficiency in operating rooms. The analysis is based on multidisciplinary ergonomic approach. The application of results is necessary for further improvement of surgeons’ efficiency, and better and more humane design of ORs. The results of this research are the basis for further research of the efficiency of professional medical staff.

Footnotes

Declaration of Conflicting Interests

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The author(s) received no financial support for the research, authorship, and/or publication of this article.

ORCID iD

Goran L. Janackovic

References

Janki

Mulder

Ijzermans

Khe Tran

. Ergonomics in the operating room. Surg Endosc. 2017;31(6):2457-2466.

van Veen-Berkx

Bitter

Kazemier

Scheffer

Gooszen

. Multidisciplinary teamwork improves use of the operating room: a multicenter study. J Am Coll Surg. 2015;220(6):1070-1076.

Sartini

Spagnolo

Panatto

Perdelli

Cristina

. Improving environmental quality in an operating room: clinical outcomes and economic implications. J Prev Med Hyg. 2013;54(2):75-79.

Ottria

Dallera

Aresu

, et al. Environmental monitoring programme in the cell therapy facility of a research centre: preliminary investigation. J Prev Med Hyg. 2010;51(4):133-138.

Jiménez-Rodríguez

Feria-Domínguez

Sebastián-Lacave

. Assessing the health-care risk: the clinical-VaR, a key indicator for sound management. Int J Environ Res Publ Health. 2018;15(4):E639.

Simsekler

MCE

Ward

Clarkson

. Design for patient safety: a systems-based risk identification framework. Ergonomics. 2018;61(8):1046-1064.

Stout

Zallman

Arsenault

Sayah

Hacker

. Developing high-functioning teams: factors associated with operating as a “real team” and implications for patient-centered medical home development. Inquiry. 2017;54:1-9.

Lingard

Regehr

Orser

, et al. Evaluation of a preoperative checklist and team briefing among surgeons, nurses, and anesthesiologists to reduce failures in communication. Arch Surg. 2008;143(1):12-17.

Amaya-Arias

Idarraga

Giraldo

Gómez

. Effectiveness of a program for improving teamwork in operating rooms. Rev Colomb Anestesiol. 2015;43(1):68-75.

10.

Cima

Brown

Hebl

, et al. Use of lean and six sigma methodology to improve operating room efficiency in a high-volume tertiary-care academic medical center. J Am Coll Surg. 2011;213(1):83-92.

11.

Phitayakorn

Minehart

Pian-Smith

, et al. Practicality of intraoperative teamwork assessments. J Surg Res. 2014;190(1):22-28.

12.

Wilson

Whyte

Gangadharan

Kent

. Teamwork and communication skills in cardiothoracic surgery. Ann Thorac Surg. 2017;103(4):1049-1054.

13.

Greenberg

CC1

Regenbogen

Studdert

, et al. Patterns of communication breakdowns resulting in injury to surgical patients. J Am Coll Surg. 2007;204(4):533-540.

14.

Burgener

. Enhancing communication to improve patient safety and to increase patient satisfaction. Health Care Manag. 2017;36(3):238-243.

15.

Lingard

Espin

Whyte

, et al. Communication failures in the operating room: an observational classification of recurrent types and effects. Qual Saf Health Care. 2004;13(5):330-334.

16.

Ali

. The role of stress in optimizing surgical performance. World J Surg. 2012;36(2):480.

17.

Wilson

Poolton

Malhotra

Ngo

Bright

Masters

. Development and validation of a surgical workload measure: the surgery task load index (SURG-TLX). World J Surg. 2011;35(9):1961-1969.

18.

Gurman

Klein

Weksler

. Professional stress in anesthesiology: a review. J Clin Monit Comput. 2012;26:329-335.

19.

Arora

Sevdalis

Nestel

Woloshynowych

Darzi

Kneebone

. The impact of stress on surgical performance: a systematic review of the literature. Surgery. 2010;147(3):318-330.

20.

Schulz

Schneider

Kohlbecher

, et al. The influence of anaesthetists’ experience on workload, performance and visual attention during simulated critical incidents. J Clin Monit Comput. 2014;28:475-480.

21.

Zheng

Cassera

Martinec

Spaun

Swanström

. Measuring mental workload during the performance of advanced laparoscopic tasks. Surg Endosc. 2010;24(1):45-50.

22.

Hughes

Forest

Foitl

Chao

. Influence of medical students’ past experiences and innate dexterity on suturing performance. Am J Surg. 2014;208(2):302-306.

23.

Lee

Kerbl

McDougall

Mucksavage

. Medical students pursuing surgical fields have no greater innate motor dexterity than those pursuing nonsurgical fields. J Surg Educ. 2012;69:360-363.

24.

Nastasea

Croitorua

Vartiresa

Tataranub

. Indoor Environmental Quality in Operating Rooms: An European Standards Review with Regard to Romanian. Bucharest, Romania: Guidelines Sustainable Solutions for Energy and Environment, EENVIRO ZRC 2015; 2015.

25.

Sánchez-Barroso

Sanz-Calcedo

. Article evaluation of HVAC design parameters in high-performance hospital operating theatres. Sustainability. 2019;11:1493.

26.

Andersson

Bergh

Karlsson

Ericsson

Nilsson

. Traffic flow in the operating room: An explorative and descriptive study on air quality during orthopaedic trauma implant surgery. Am J Infect Control. 2012;40:750-755.

27.

Kurmann

Peter

Tschan

Mühlemann

Candinas

Beldi

. Adverse effect of noise in the operating theatre on surgical-site infection. Br J Surg. 2011;98(7):1021-1025.

28.

Weiser

Haynes

Dziekan

Berry

Lipsitz

Gawande

. Effect of a 19-item surgical safety checklist during urgent operations in a global patient population. Ann Surg. 2010;251(5):976-980.

29.

de Vries

Prins

Crolla

, et al. Effect of a comprehensive surgical safety system on patient outcomes. N Engl J Med. 2010;363(20):1928-1937.

30.

Hollund

. [In Norwegian] Checklist - paperwork or team effort? An Observational Study of Safe Work Practices in OR teams. Master Thesis. University of Stavanger; 2010. http://brage.bibsys.no/xmlui/handle/11250/184650. Accessed May 30, 2020.

31.

Høyland

Aase

Hollund

Haugen

. What is it about checklists? Exploring safe work practices in surgical teams. In: C

Bieder

Bourrier

, eds Trapping safety into rules: How desirable and avoidable is proceduralization of safety?. Farnham: Ashgate Publishing Ltd; 2013:164-188.

32.

Lindlohr

Lefering

Saad

Heiss

Pape-Köhler

. Training or non-surgical factors—what determines a good surgical performance? A randomised controlled trial. Langenbeck’s Arch Surg. 2017;402(4):645-663.

33.

Grozdanovic

Janackovic

Stojiljkovic

. The selection of the key ergonomic indicators influencing work efficiency in the railway control rooms. Trans Inst Meas Control. 2016;38(10):1174-1185.

34.

Grozdanovic

. Research on key indicators in modern surgical practice assessment–ergonomic approach. Surg Innovat. 2018;25(4):323-332.

35.

Bulut

Duru

Keçeci

Yoshida

. Use of consistency index, expert prioritization and direct numerical inputs for generic fuzzy-AHP modeling: a process model for shipping asset management. Expert Syst Appl. 2012;39(2):1911-1923.

36.

Nagpal

Vats

Lamb

, et al. Information transfer and communication in surgery: a systematic review. Ann Surg. 2010;252(2):225-239.

37.

Andersson

Rankin

Diptee

. Approaches to team performance assessment: a comparison of self-assessment reports and behavioral observer scales. Cogn Technol Work. 2017;19(2-3):517-528.

38.

Gillespie

Gwinner

Chaboyer

Fairweather

. Team communications in surgery–creating a culture of safety. J Interprof Care. 2013;27(5):387-393.

39.

Henrickson

Yule

Flin

McKinley

. Surgeons’ leadership in the operating room: an observational study. Am J Surg. 2012;204(3):347-354.

40.

Manser

. Teamwork and patient safety in dynamic domains of healthcare: a review of the literature. Acta Anaesthesiol Scand. 2009;53(2):143-151.

41.

Tiwary

Rimal

Paudyal

Sigdel

Basnyat

. Poor communication by health care professionals may lead to life-threatening complications: examples from two case reports. Wellcome Open Res. 2019;4:7.