Sage Journals: Discover world-class research

Abstract

Background

Despite numerous efforts to improve surgical safety, adverse events and serious surgical complications are still common. This cross-sectional study at a tertiary hospital in Ontario, Canada, aimed to examine nurses’ perceptions, awareness, comfort, and readiness to use Operating Room Black Box (ORBB) technology, implemented to reduce surgical errors.

Methods

A mixed method was used and data was collected through a 14-item questionnaire in summer 2022.

Results

Among 50 nurse participants, nurses with work experience <20 years had higher overall mean scores on 9 questions than nurses working >20 years. The majority (88.0%) had no prior ORBB experience but somewhat agreed that ORBB had the potential to improve the safety culture in the operating room.

Conclusion

Overall, nurses demonstrated positive attitudes towards ORBB technology, indicating its potential to enhance safety culture, team communication, teamwork, situational awareness, feedback on performance, the debriefing process, transparency, and lead to technological advancements in healthcare.

Keywords

operating room black box surgical safety nurse perceptions patient safety surgical complications technology adoption OR workflow

Background

Extensive efforts to enhance surgical safety have been undertaken, yet the incidence of adverse events and patient harm during surgery remains substantial.^1,2 Serious surgical complications affect a significant proportion of the more than 200 million operations conducted globally each year, with human factors or system errors accounting for approximately half of these complications deeming them potentially preventable.^3-5 A significant portion of surgical errors are a result of adverse events in the operating room (OR), and no individual, regardless of their clinical competence, is immune from it.^3,6-8 Even prior to the surgical intervention stage, diagnostic errors occur across various disciplines and throughout all phases of care, with contributing factors frequently linked to communication breakdown and provider clinical decision-making.⁹ Thus, human error pervasively contributes to issues along the continuum of care. The ORBB technology, which is similar to aviation black box flight recorders, is intended to capture synchronized information during surgical procedures in a systematic and impartial manner,^3,4,10,11 providing a documented account of human errors and adverse events.

The ORBB technology can be used to objectively and precisely document a clinical procedure in the OR (e.g., team performance, resiliency supports, and interpersonal communications), allowing for more prospective evaluation and purposeful retrospective case review, and can inform better technical improvement and improve intraoperative error detection (e.g., near misses and distractions).^3,12,13,18 Awareness of factors influencing patient care can lead to interventions (e.g., noise control during certain phases of surgery) that are specific to the surgical team environment, thereby optimizing patient safety within that context.^13,14 Furthermore, the ORBB technology can help to reduce postoperative errors, reveal implicit behaviors that might otherwise go unnoticed without recording, identify potential causes that compromise patient health and safety, and improve patient outcomes and quality of care.^8,11,14,15 ORBB evaluates trainees’ performance objectively, emphasizing what works and what needs to be improved.¹² Furthermore, it allows for objective monitoring of trainees’ progress throughout training, promoting competency-based education.^12,16 Moreover, ORBB technology can elucidate intraoperative factors that have a negative impact on patient care (e.g., errors and adverse events) such as medication errors, which is one of the most common forms of medical errors.¹⁷ It can also significantly improve the method of professional development currently used by perioperative nurses and surgeons because they can benefit professionally from reviewing OR footage and identify opportunities for improvement.^11,13,18 Based on the many benefits, a large urban teaching hospital in Toronto is in the preliminary stages of a 3-year black box implementation study. Successful implementation of new technology is heavily reliant on successful adoption.¹⁹ Stakeholder acceptance may be the single most important deciding factor in whether a new technology succeeds or fails.^20,21 Studies have shown that increasing stakeholder knowledge and awareness prior to new technology adoption can foster better user reception.^22,23 One of these key stakeholders are nurses, who play a critical role in the healthcare workforce and more specifically in surgical settings where the ORBB technology is intended to be used. For these reasons the current investigation sought to engage nurse feedback in an effort to promote nurse buy-in, a crucial component to reducing potential barriers to successful adoption of new technology like ORBB.^24-26 In the current investigation, the initial aim of increased awareness of ORBB technology was achieved through engagement and assessment of how the technology can be used to improve surgical processes through the use of a survey tool designed to solicit nurse feedback. Furthermore, this was a pilot study that was part of a larger study, and perceptions of ORBB were being evaluated on one unit, not the entire hospital. The study aimed to assess nurses’ awareness, comfort, and readiness to use ORBB technology, as well as to explore how to use ORBB technology most effectively in the surgical setting. The research team also identified a knowledge gap in the lack of a tool to examine nurses’ perceptions of ORBB technology in a surgical setting, which this study sought to address.

Materials and Methods

The study was conducted at a prominent academic health sciences center in Canada. This tertiary center is known for its advanced research and patient care and is affiliated with a university serving as a major teaching hospital. This healthcare center is in the preliminary stages of a 3-year black box implementation study. The research team planned to install 2 black boxes, one in OR03 and one in OR01, equipped with cameras, encoders, a touchscreen, and microphones to gather data during surgical procedures. The data collected was transmitted to the IT Closet in OR03 and then securely transferred to Surgical Safety Technology’s (SST’s) data center for analysis. There was a collaboration between the tertiary hospital and another local hospital indicating a coordinated effort in adopting this technology. In this current study, we wanted to look at nurses’ perceptions of ORBB technology in surgical settings, specifically focusing on identifying the key benefits that nurses believe ORBB technology can offer in enhancing surgical practices.

Participant Recruitment

The study subjects consisted of nurses at a tertiary hospital who were introduced to the ORBB during a team meeting, as part of the ORBB implementation initiative. This cross-sectional study employed a mixed-methods approach, combining quantitative and qualitative methods. While the study design was primarily quantitative, by incorporating a questionnaire as the main research tool, qualitative insights were also gathered through an open-ended question in the questionnaire. All nurses on the unit within the hospital were identified and invited to participate in the research project; the nursing champion assumed the role of recruiting participants, and introduced the survey via email. Nurses were invited to participate in the study and the questionnaire was distributed to them during team staff meetings. Completion of the questionnaire implied consent.

Ethical Considerations

Given the Quality Improvement (QI) nature of the project, the urban teaching hospital site completed an Ethics Review using the Self Assessment Tool (ER-SAT), which confirmed the quality improvement status of the project. The Research Ethics Board approved the study protocol on Monday September 19th, 2022 (REB 2022-398) to allow the data collected to be used for secondary publication purposes.

Measurement Instruments and Procedure

The study employed a mixed methods approach, including quantitative and qualitative methods, to examine nurses’ perceptions towards ORBB technology and its potential to improve processes in the operating room (OR) from the nurses’ perspective. The study was primarily quantitative, aiming to identify the most significant potential benefits that nurses believe ORBB technology can achieve in a surgical setting at a tertiary hospital. The primary research methodology was a questionnaire modified from existing literature to fit the context of ORBB technology.^3,4,7,11,14 The study questionnaire was distributed to nurses working on a single unit at the tertiary hospital in the Fall of 2022. The nursing champion identified 50 nurses as potential participants. All 50 consented to participate in the study and completed the questionnaire. Moreover, no additional sampling procedures were required because all 50 nurses consented on the unit were recruited and participate in the pilot study.

The questionnaire was distributed by the nursing champion to both Registered Nurses (RNs) and Registered Practical Nurses (RPNs). Prior to distribution, nurses were informed about the survey in team staff meetings and were told that completion of the survey would serve as their consent. Recruitment began on June 10, 2022, and ended on June 17, 2022. The nursing champion distributed questionnaires exclusively to nurses following 2 consecutive Friday team staff meetings at the tertiary hospital. The questionnaire consisted of 9 questions about nurses’ perspectives on ORBB technology, expressed on a 7-point Likert scale ranging from 1 (strongly disagree) to 7 (strongly agree). The 9 questions, as shown in Appendix 1, were Q1: to improve operating room safety culture; Q2: to improve operating room team communication; Q3: to improve teamwork and collaboration in the operating room; Q4: to improve situational awareness of the surgical team; Q5: to receive appropriate and timely feedback on performance; Q6: to improve the debriefing process; Q7: to identify potential intraoperative safety risks (e.g., cognitive and auditory distractions, door opening, non-case-related conversations, repeated turnover of personnel); Q8: to increase transparency in the clinical setting; and Q9: to lead to technological advancements in health care. A score of 1 indicated strongly disagree; a score of 2 indicated disagree; a score of 3 indicated somewhat disagree; a score of 4 indicated neutral; a score of 5 indicated somewhat agree; a score of 6 indicated agree; and a score of 7 indicated strongly agree. As a result, an item score of 5 to 7 indicated a positive response. A total domain score of 35 or higher indicated more positive attitudes toward the use of ORBB technology.

The final questionnaire contained 14 items constructed by the research team based on previous studies to capture nurses’ perceptions of ORBB technology and how it could be used to improve processes in the OR.^{3,4,11,14,27-29} The responses to 9 of the 14 questions were based on a 7-point Likert scale. The second survey section included an open-ended question that invited nurses to provide a written response in the free-text box field about their perceptions toward the use of ORBB technology, and how it could be used to improve processes in the OR.

Statistical Analysis

The reliability and validity of the constructs were calculated. Constructs were combined to perform factor analysis. Factor loading depicts the relationship between each item and the associated constructs.³⁰ Principal axis factoring (PAF) with Varimax rotation was used for all 9 variables. All variables were loaded into a single component and were calculated loading factors. Convergent validity was assessed using the outer loadings of the indicators. Moreover, internal validity was assessed using Cronbach’s alpha. Cronbach’s alpha (α) > 0.70 is typically considered to be significant and an “acceptable” level of reliability.³¹

Additionally, the content validity of the questionnaire was established by reviewing several works of literature on the subject, modifying the questionnaire based on feedback and comments from the 5 colleagues to whom the questionnaire was initially piloted, and incorporating the expert opinion of the research team members.^{3,11,14,27-29}

Descriptive statistics were computed for all baseline demographic characteristics. Characteristics were presented as n (number of individuals), frequencies, and percentages (%), as appropriate. Chi-Square tests were used where appropriate to test the relationships between construct responses and variables (e.g., gender, role in the OR, work experience, and ORBB experience).

Furthermore, the Chi-Square Test was corrected, resulting in the Fisher-Freeman-Halton Exact Test being used to determine the association between the variables. The Cronbach alpha was used to assess internal validity.³² Cronbach alpha values between 0.7 and 0.9 are considered satisfactory.³³ The outer loadings of the indicators were used to assess convergent validity.³² The outer loadings should be 0.708 or higher to help establish convergent validity on the construct.³³ All paper data records from participants were converted to a password-protected Excel database (version 2010) and exported into SPSS Statistics (version 25; IBM Corporation). The results of the survey were analyzed using SPSS Statistics for descriptive statistics. The level of statistical significance was set at P < 0.05.

Results

Participants Characteristics

In Fall 2022, all 50 nurses consented on the unit were recruited, representing the entire nursing population within the unit. The 50 participants comprised mostly females (82.0%), and only 8.0% individuals who did not indicate their gender (Table 1). With regards to role in the OR, the highest number of nurses (44.0%) were both scrub and circulating nurses followed by scrub nurses (32.0%), circulating nurses (20.0%), and 4.0% did not indicate their role in the OR. Most of the nurses (42%) work experience 21 years followed by < 10 years (32%) and 20-29 years (18%). When they were asked about ORBB experience, Majority (88.0%) nurses did not have ORBB experience.

Table 1.

Sociodemographic Characteristics of the Respondents (n = 50)

Variable	n (%)
Gender
Male	5 (10.0)
Female	41 (82.0)
Other/undisclosed	4 (8.0)
Role in the OR
Scrub nurse	16 (32.0)
Circulating nurse	10 (20.0)
Dual roles	22 (44.0)
Undisclosed	2 (4.0)
Work experience (years)
<10	16 (32.0)
10-19	21 (42.0)
20-29	9 (18.0)
30-39	1 (2.0)
≥40	1 (2.0)
Undisclosed	2 (4.0)
ORBB experience
No	44 (88.0)
Yes	3 (6.0)
Undisclosed	3 (6.0)
Total	50 (100)

Scale Reliability

Table 2 describes the reliability and validity of the constructs. For each of the 9 variables, Principal axis factoring (PAF) with Varimax rotation was used, and factor loadings were all above 0.8. Convergent validity using the outer loadings of the indicators were all >0.708, ranging from 0.85 to 0.94, which established the convergent validity of the construct.³³ Also, the Corrected Item-Total Correlation for the 9 individual components of the multi-item scale were all >0.30, ranging from 0.833 to 0.922; this indicated that these items belong on the scale because they demonstrated high internal consistency, and all measured the same construct. Moreover, internal validity. Cronbach’s alpha was 0.973 for 9 items on the questionnaire (Table 2). This value indicated that the scale had high levels of inter-item reliability. Because Cronbach’s Alpha (α) was α > 0 .70.³³

Table 2.

Construct Reliability

Construct*	Factor loading	Correlated item-total correlation	Cronbach alpha
Q1	.845	.833	.973
Q2	.880	.867
Q3	.900	.886
Q4	.904	.892
Q5	.914	.901
Q6	.930	.915
Q7	.938	.922
Q8	.857	.844
Q9	.905	.892

*Q1: safety culture, Q2: team communication, Q3: teamwork, Q4: situational awareness, Q5: feedback, Q6: debriefing process, Q7: identifying safety risks,Q8: transparency, and Q9: technological advancements in healthcare.

Perceptions Towards Black Box

To evaluate the perceived impact of ORBB technology on various aspects of operating room performance (safety culture, team communication, teamwork, situational awareness, feedback, debriefing process, identifying safety risks, transparency, and technological advancements in healthcare), participants rated their agreement with statements on a Likert scale ranging from 1 (Strongly Disagree) to 7 (Strongly Agree). The primary focus was to assess overall perceptions of ORBB technology, primarily captured in Part 2 of the questionnaire, with construct summary measures derived from 9 researcher-generated questions (Table 3). Firstly, gender was significantly associated with the perceived potential of ORBB in several aspects. Women were more likely to agree that ORBB can help improve the safety culture (P = .012), improve situational awareness (P = .010), receive feedback on performance (P = .015), improve the debriefing process (P = .015), potential intraoperative safety risks (P = .005), and lead to technological advancements (P = .030) (Table 3). However, perceptions did not significantly vary by role in the OR, work experience, or ORBB experience. (Table 3).

Table 3.

P Values for Likelihood Ratio and Fisher-freeman-halton Exact Test

Construct	Gender		Role in the OR		Work experience (years)		ORBB experience
	P Value
	Likelihood ratio	Fisher-freeman-halton exact test	Likelihood ratio	Fisher-freeman-halton exact test	Likelihood ratio	Fisher-freeman-halton exact test	Likelihood ratio	Fisher-freeman-halton exact test
Q1	.012*	.012*	.423	.576	.192	.128	.416	.235
Q2	.203	.203	.945	.953	.921	.942	.195	.195
Q3	.230	.138	.633	.759	.584	.452	.051	.080
Q4	.010*	.010*	.623	.619	.527	.462	.116	.116
Q5	.015*	.015*	.674	.824	.077	.073	.092	.092
Q6	.015*	.015*	.716	.874	.424	.293	.054	.085
Q7	.005**	.005*	.369	.572	.070	.048	.624	.374
Q8	.196	.078	.302	.398	.352	.245	.720	.355
Q9	.030*	.030*	.328	.488	.255	.183	.111	.111

Level of significance at <0.05*, 0.005**, Q1: safety culture, Q2: team communication, Q3: teamwork, Q4: situational awareness, Q5: feedback, Q6: debriefing process, Q7: identifying safety risks,Q8: transparency, and Q9: technological advancements in healthcare.

Overall Participant Responses to Questionnaire Items

In Table 4, participant responses to the 9 questionnaire items irrespective of gender, role in the OR, work experience, and ORBB experience were examined. Overall, most participants had positive perceptions toward ORBB. With regards to improving the safety culture in the operating room (Q1), 58.0% (n = 29) agreed (ranging from somewhat agree to strongly agree); 28.0% (n = 14) disagreed (ranging from somewhat agree to strongly agree); and 14.0% (n = 7) were neutral. The highest percentage of respondents (n = 13, 26.0%) somewhat agreed. With regards to improving team communication in the operating room (Q2), 40.0% (n = 20) agreed; 42.0% (n = 21) disagreed; and 14.0% (n = 7) were neutral. The highest percentage of respondents (n = 9, 18.0%) agreed. With regards to improving teamwork and collaboration in the operating room (Q3), 48.0% (n = 24) agreed; 34.0% (n = 17) disagreed; and 18.0% (n = 9) were neutral. The highest percentage of respondents (n = 10, 20.0%) strongly agreed.

Table 4.

Overall Participant Responses to the Questionnaire

Construct	n (%)
Construct	1 strongly disagree	2 disagree	3 somewhat disagree	4 neutral	5 somewhat agree	6 agree	7 strongly agree	Total (Missing responses)
Q1	6 (12.0)	5 (10.0)	3 (6.0)	7(14.0)	13 (26.0)	10(20.0)	6 (12.0)	50
Q2	6 (12.0)	8 (16.0)	7 (14.0)	7(14.0)	5 (10.0)	9 (18.0)	6 (12.0)	48 (2)
Q3	8 (16.0)	5 (10.0)	4 (8.0)	9(18.0)	9 (18.0)	5 (10.0)	10 (20.0)	50
Q4	7 (14.0)	4 (8.0)	4 (8.0)	8(16.0)	14 (28.0)	7(14.0)	6 (12.0)	50
Q5	3 (6.0)	6 (12.0)	5 (10.0)	5(10.0)	13 (26.0)	9 (18.0)	9 (18.0)	50
Q6	5 (10.0)	6 (12.0)	4 (8.0)	7(14.0)	13 (26.0)	8 (16.0)	7 (14.0)	49 (1)
Q7	7 (14.0)	6 (12.0)	4 (8.0)	6(12.0)	11 (22.0)	9 (18.0)	7 (14.0)	50
Q8	7 (14.0)	2 (4.0)	3 (6.0)	7(14.0)	14 (28.0)	10(20.0)	7 (14.0)	50
Q9	4 (8.0)	5 (10.0)	4 (8.0)	5(10.0)	8 (16.0)	14(28.0)	9 (18.0)	49 (1)

Q1: safety culture, Q2: team communication, Q3: teamwork, Q4: situational awareness, Q5: feedback, Q6: debriefing process, Q7: identifying safety risks, Q8: transparency, and Q9: technological advancements in healthcare.

With regards to improving the situational awareness of the surgical team (Q4), 54.0% (n = 27) agreed; 30.0% (n = 15) disagreed; and 16.0% (n = 8) were neutral. The highest percentage of respondents (n = 14, 28.0%) agreed. With regards to receiving appropriate and timely feedback on performance (Q5), 62.0% (n = 31) agreed; 28.0% (n = 14) disagreed; and 10.0% (n = 5) were neutral. The highest percentage of respondents (n = 13, 26.0%) somewhat agreed. With regards to improving the debriefing process (Q6), 56.0% (n = 28) agreed; 30.0% (n = 15) disagreed; and 14.0% (n = 7) were neutral. The highest percentage of respondents (n = 13, 26.0%) somewhat agreed. With regards to identifying potential intraoperative safety risks (Q7), 54.0% (n = 27) agreed; 30.0% (n = 15) disagreed; and 12.0% (n = 6) were neutral. The highest percentage of respondents (n = 11, 22.0%) somewhat agreed. With regards to increasing transparency in the clinical setting (Q8), 62.0% (n = 31) agreed; 24.0% (n = 12) disagreed; and 14.0% (n = 7) were neutral. The highest percentage of respondents (n = 14, 28.0%) somewhat agreed. Lastly, with regards to leading to technological advancements in health care (Q9), 62.0% (n = 31) agreed; 26.0% (n = 13) disagreed; and 10.0% (n = 5) were neutral. The highest percentage of respondents (n = 14, 28.0%) agreed. Furthermore, for each of the 9 questionnaire items, a small percentage of respondents strongly disagreed, ranging from 6.0% to 16.0%.

Participant Responses to Open-Ended Questions

The final item (Question 10) was an open-ended question inviting a written response regarding the potential uses and/or anticipated benefits of ORBB technology for nurses in a surgical setting at the tertiary hospital. Specifically, how nurses believe this technology can be used to improve processes in the OR. This question was completed by 9 of 50 (18%) participants, resulting in 41 incomplete sections for this aspect of the survey. Among the 9 participants who completed this section, some expressed positive attitudes toward the use of ORBB technology, while others expressed negative attitudes, and others provided neutral responses (Participant 3). ORBB, according to participants, can be “seen as a way to punish team members” and forces employees to “obligate and agree or [they] will be barred from working in the [operating] room” (Participant 1; Participant 2). Participants were also “worried about [the] potential use of materials for litigation purposes” and how “this technology is detrimental to the surgical team” (Participant 2; Participant 5). According to Participant 8, ORBB is “likely to cause many nurses to change their behaviours in the OR” and become “anxious and distracted about potential repercussions, which may negatively impact patient care.” It was also stated that there could be “potential misinterpretation of video, audio, or the implications to patients” and “there is no need for it [ORBB] in OR” (Participant 2; Participant 6). However, participants also articulated more positive feelings about ORBB. Participants expressed that “black box has the potential to improve quality of care of staff performance” as well as “address patient safety and efficiency in the OR” (Participant 4; Participant 7). Participants also commented that “there appear to be several advantages to using black box technology” and it has “the potential to standardize procedures in a way that will improve care” (Participant 4; Participant 9). Furthermore, participants expressed that “for this technology to be more widely adopted, the benefits of the black box must be balanced with effective policies that protect the interests of both nurses and their patients,” and staff “have to feel safe from concerns” (Participant 5; Participant 9).

Discussion

This study examined nurses’ perceptions of novel surgical application ORBB technology at an academic health center located in Canada. The primary focus was to understand its potential to improve surgical processes and engage nurses in quality improvement measures. The results of the study highlight the influence of gender on nurses’ perceptions to ORBB technology. These findings underline a critical gap in Canadian literature by showcasing the various factors that affect perceptions of ORBB technology.

This study found significant gender differences in perceptions of ORBB technology with male participants (10.0%) showing fewer positive attitudes compared to female participants (82.0%). Given that nursing is a female-dominated profession, there is a lack of research focusing on gender-based or sex differences in nurses’ perceptions of technology³⁴ as females are largely overrepresented in studies. However, Korte et al.³⁵ and their team showed that male nurses display more technical readiness compared to female nurses. These gender differences between male and female nurses could be due to the increase of technology-based educational tools within the nursing department aimed to improve healthcare operations among nurses.³⁶ espite the gap in the literature on gender differences among nurses’ perceptions of technology, the findings of our study indicate a need for future research with proportional gender representation to gain further insights.

While the nurses’ role did not produce statistically significant findings, the nursing role trends observed were consistent with the findings from other similar studies that reported significant effects.³⁷ In both studies, scrub nurses reported the most positive perceptions of ORBB technology, relative to dual role and circulating nurses. Zuzelo et al,³⁷ suggested that these specialized nurses may be more accustomed to new technologies given their roles. Similarly, while statistically insignificant, the impact of years of nursing experience on ORRB attitudes demonstrated trends whereby the most experienced nurses reported the most positive attitudes toward ORBB technology. These findings contrast with previous studies indicating the opposite finding with younger healthcare professionals reported more positive attitudes around the use of new technologies.^38,39 Several studies have reported a correlation between resistance to change that is positively correlated with increased experience.^23,39,40 Other studies have shown that targeted education, specific training, and mentoring may aid in the implementation of ORBB technology among circulating and dual-role nurses.^23,26 Additionally, studies suggest that constant support and practice opportunities could enhance the transition to this new technology.^23,40-43

Despite a lack of statistical significance, an interesting relationship between prior exposure to ORBB technology and favorable perceptions was noted warranting further investigation with a larger sample size. Nurses who had no prior exposure to ORBB technology reported higher mean scores, relative to nurses with prior exposure. This finding aligns with previous studies that have used the technology acceptance model (TAM), where individuals are more likely to be receptive and have favorable perceptions of new technology because it is perceived as innovative.^44-46 The perceived usefulness and ease of use of this technology could have influenced the participants’ perception of ORBB technology despite not having prior exposure.

Another finding identified in this study was nurses’ lack of readiness for change. This was exemplified through nurses’ statements that ORBB technology would be detrimental to the surgical team; result in potential misinterpretation, distractions, and surgical team members changing their behaviour; and ORBB technology implementation is simply unnecessary. These perceptions and their impact on implementation require further investigation.

It is important to devise a thorough education and engagement strategy before implementing ORBB technology⁴⁷ to maintain the emphasis on continuous quality improvement. As well, there should be clear information provided about data management, usage, and legal aspects to alleviate healthcare professionals’ fears.⁴⁸ As the rollout of this ORBB technology continues, it would be beneficial to repeat the survey 6 months after ORBB implementation to gauge nurses’ attitudes and readiness more accurately, given that at that point, they will have more engagement with ORBB. The findings from a follow-up survey would provide feedback that could be used to adjust or improve ORBB processes, to ensure continuous quality improvement. Additionally, as ORBB technology is rolled out to other surgical departments across the hospital it will allow for the opportunity to expand the sample, providing access to more robust quantitative and qualitative data.

Limitations

The lack of response on all open-ended questions (only 9 out of 50 responses in the open-ended question) may represent a non-response bias or a form of resistance or a lack of familiarity and knowledge, in which the nurse participants who did not respond may have a negative or impartial attitude toward the questionnaire or operative recording in general. The quantitative approach of this ORBB study also has limitations in terms of the amount of detail and individual variation that it can capture. Future qualitative studies could be conducted to further elucidate healthcare professionals’ perspectives on ORBB technology. The small sample size is another limitation of this study, which only allowed for large differences to be detected between groups. There was also a disproportionate male-to-female participant ratio, with 41 female-identified participants compared to 5 male-identified participants, while this aligns with other study findings, gender differences could not be fully examined because of the unequal sample sizes between the 2 genders.⁴⁹ This was a single-hospital study involving a specific population of interest, professionally and geographically at a single point in time; the opinions expressed in this study may not be representative of the opinions expressed by nurses at other institutions. Though the findings of this study may not be broadly generalizable across other hospital settings, they may serve as a foundation for future research into nurses’ concerns about operative recording and strategies to encourage the uptake of this novel tool.

Also, future research that intends to conduct a similar study should recognize that Registered Nurses can work dual roles in the OR. An oversight in this survey was that it only provided the option for participants to select their role in the OR as “Scrub nurse” or “Circulating nurse.” However, nurses who worked both roles in the OR indicated their dual role status by circling both roles on the questionnaire; this improved data accuracy by allowing dual role status to be acknowledged throughout the paper.

Conclusion

Overall, the study findings showed that while there was general agreement on the potential benefits of using ORBB technology, there were also concerns and hesitations among nurses, particularly regarding data privacy, usage, and potential repercussions. Despite assurances of de-identification and data scrubbing, participants expressed anxiety and distraction as the key concerns around knowing they would be recorded. These findings suggest that nurses may be hesitant or resistant to adopting ORBB technology, which should be a consideration in the ORBB adoption plan.

Footnotes

ORCID iD

Pria Nippak

Author contributions

All authors listed have contributed to the study conception and design. Pria Nippak, Victoria Ross, Housne Begum, Kimberley Okafor, Stanley Hamstra, Markku Nousianinen, all contributed to the design of the research, data collection, and writing of the manuscript. All authors proofread and approved the final manuscript.

Funding

The authors received no financial support for the research, authorship, and/or publication of this article.

Declaration of conflicting interests

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Appendix

References

Santos

Jones

. Prevention of surgical errors. In: StatPearls. StatPearls Publishing; 2023.

Cram

Cohen

Landon

Hall

Jackson

. Surgical outcomes in Canada and the United States: an analysis of the ACS-NSQIP clinical registry. World J Surg. 2022;46(5):1039-1050. doi:10.1007/s00268-022-06444-w

Boet

Etherington

Lam

, et al. Implementation of the operating room black box research program at the Ottawa hospital through patient, clinical, and organizational engagement: case study. J Med Internet Res. 2021;23(3):e15443.

Nensi

Palter

Reed

, et al. Utilizing the operating room black box to characterize intraoperative delays, distractions, and threats in the gynecology operating room: a pilot study. Cureus. 2021;13(7):e16218. doi:10.7759/cureus.16218

Vacheron

Acker

Autran

, et al. Insurance claims for wrong-side, wrong-organ, wrong-procedure, or wrong-person surgical errors: a retrospective study for 10 years. J Patient Saf. 2023;19(1):e13-e17. doi:10.1097/PTS.0000000000001080

Sameera

Bindra

Rath

. Human errors and their prevention in healthcare. J Anaesthesiol Clin Pharmacol. 2021;37(3):328-335. doi:10.4103/joacp.JOACP_364_19

Gordon

Reed

Sorensen

, et al. Perceptions of safety culture and recording in the operating room: understanding barriers to video data capture. Surg Endosc. 2021;36:3789-3797. doi:10.1007/s00464-021-08695-5

Jue

Shah

Mackey

. An interdisciplinary review of surgical data recording technology features and legal considerations. Surg Innov. 2020;27(2):220-228. doi:10.1177/1553350619891379

Kwan

Calder

Bowman

, et al. Characteristics and contributing factors of diagnostic error in surgery: analysis of closed medico-legal cases and complaints in Canada. Can J Surg. 2024;67(1):E58-E65. doi:10.1503/cjs.003523

10.

Mascagni

Padoy

. OR black box and surgical control tower: recording and streaming data and analytics to improve surgical care. J Vis Surg. 2021;158(3):S18-S25. doi:10.1016/j.jviscsurg.2021.01.004

11.

Nelson

. Improving perioperative patient safety using black box technology. AORN J. 2020;111(3):285-287. doi:10.1002/aorn.12966

12.

Doyen

Gordon

Soenens

, et al. Introduction of a surgical black box system in a hybrid angiosuite: challenges and opportunities. Phys Med. 2020;76:77-84. doi:10.1016/j.ejmp.2020.06.013

13.

Schulthess

Neuenschwander

Mosalam

Knobloch

. A computationally rigorous approach to hybrid fire testing. Comput Struct. 2020;238:106301. doi:10.1016/j.compstruc.2020.106301

14.

Etherington

Usama

Patey

, et al. Exploring stakeholder perceptions around implementation of the operating room black box for patient safety research: a qualitative study using the theoretical domains framework. BMJ Open Qual. 2019;8(3):e000686. doi:10.1136/bmjoq-2019-000686

15.

Virji

Khan

Begum

. Operating room black box: GIMMICK or a patient safety tool? J Pakistan Med Assoc. 2024;74(4):S85-S89. doi:10.47391/JPMA.AKU-9S-13

16.

Møller

Sørensen

Topperzer

, et al. Implementation of an innovative technology called the OR Black Box: a feasibility study. Surg Innov. 2023;30(1):64-72. doi:10.1177/15533506221106258

17.

Meier

Daniel

, et al. Impact of team performance on the surgical safety checklist on patient outcomes: an operating room black box analysis. Surg Endosc. 2024;38(10):5613-5622. doi:10.1007/s00464-024-11064-7

18.

Bam

Safowaa

Lomotey

Nkansah

. Nursing students' perception of medical errors: a cross-sectional study in a university. Nurs Open. 2021;8(6):3152-3160. doi:10.1002/nop2.1028

19.

van Gemert-Pijnen

. Implementation of health technology: directions for research and practice. Front Digit Health. 2022;4:1030194. doi:10.3389/fdgth.2022.1030194

20.

Greenhalgh

Wherton

Papoutsi

, et al. Beyond adoption: a new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies. J Med Internet Res. 2017;19(11):e367. doi:10.2196/jmir.8775

21.

Wade

Eliott

Hiller

. Clinician acceptance is the key factor for sustainable telehealth services. Qual Health Res. 2014;24(5):682-694.

22.

Barchielli

Marullo

Bonciani

Vainieri

. Nurses and the acceptance of innovations in technology-intensive contexts: the need for tailored management strategies. BMC Health Serv Res. 2021;21:639. doi:10.1186/s12913-021-06628-5

23.

Booth

Strudwick

McBride

O’Connor

Solano López

. How the nursing profession should adapt for a digital future. BMJ. 2021;373:n1190. doi:10.1136/bmj.n1190

24.

Eley

Fallon

Soar

Buikstra

Hegney

. Barriers to use of information and computer technology by Australia's nurses: a national survey. J Clin Nurs. 2009;18(8):1151-1158. doi:10.1111/j.1365-2702.2008.02336.x

25.

Jaafarpour

Khani

. The participation of nurses in decision making. J Clin Diagn Res. 2011;5(1):16-19.

26.

De Leeuw

Woltjer

Kool

. Identification of factors influencing the adoption of health information technology by nurses who are digitally lagging: in-depth interview study. J Med Internet Res. 2020;22(8):e15630. doi:10.2196/15630

27.

Guerlain

Adams

Turrentine

, et al. Assessing team performance in the operating room: development and use of a “black-box” recorder and other tools for the intraoperative environment. J Am Coll Surg. 2005;200(1):29-37. doi:10.1016/j.jamcollsurg.2004.08.029

28.

Incze

Pinkney

, et al. Using the operating room black box to assess surgical team member adaptation under uncertainty: an observational study. Ann Surg. 2024;280(1):75-81. doi:10.1097/SLA.0000000000006191

29.

Jung

Jüni

Lebovic

Grantcharov

. First-year analysis of the operating room black box study. Ann Surg. 2018;271(1):122-127. doi:10.1097/SLA.0000000000002863

30.

Hair

Black

Babin

, et al. Multivariate Data Analysis. 7th ed. Prentice Hall; 2009.

31.

Shemwell

Chase

Schwartz

. Seeking the general explanation: a test of inductive activities for learning and transfer. J Res Sci Teach. 2015;52(1):58-83. doi:10.1002/tea.21185

32.

Hair

Sarstedt

Ringle

, et al. Advanced Issues in Partial Least Squares Structural Equation Modeling. Sage Publications Inc.; 2017.

33.

Nunnally

Bernstein

. Psychometric Theory. 3rd ed. McGraw-Hill; 1994.

34.

Mohammadnejad

Freeman

Klassen-Ross

Hemingway

Banner

. Impacts of technology use on the workload of registered nurses: a scoping review. J Rehabil Assist Technol Eng. 2023;10:20556683231180189. doi:10.1177/20556683231180189

35.

Korte

Bohnet-Joschko

. Technical readiness and stereotypes in hospital nursing-A question of gender and age? Nurs Rep. 2023;13(1):116-127. doi:10.3390/nursrep13010013

36.

Rezayi

Niakan Kalhori

Saeedi

. Effectiveness of artificial intelligence for personalized medicine in neoplasms: a systematic review. BioMed Res Int. 2022;2022:7842566. doi:10.1155/2022/7842566

37.

Zuzelo

Gettis

Hansell

Thomas

. Describing the influence of technologies on registered nurses' work. Clin Nurse Spec. 2008;22(3):132-140.

38.

Nakagawa

Yellowlees

. Inter-generational effects of technology: why millennial physicians may Be less at risk for burnout than baby boomers. Curr Psychiatry Rep. 2020;22(9):45. doi:10.1007/s11920-020-01171-2

39.

Edgcumbe

. Age differences in open-mindedness: from 18 to 87 years of age. Exp Aging Res. 2021;48(1):1-18. doi:10.1080/0361073X.2021.1923330

40.

Wynn

Garwood-Cross

Vasilica

Griffiths

Heaslip

Phillips

. Digitizing nursing: a theoretical and holistic exploration to understand the adoption and use of digital technologies by nurses. J Adv Nurs. 2023;79(10):3737-3747. doi:10.1111/jan.15810

41.

Altmiller

Pepe

. Influence of technology in supporting quality and safety in nursing education. Nurs Clin. 2022;57(4):551-562. doi:10.1016/j.cnur.2022.06.005

42.

Stoumpos

Kitsios

Talias

. Digital transformation in healthcare: technology acceptance and its applications. Int J Environ Res Publ Health. 2023;20(4):3407. doi:10.3390/ijerph20043407

43.

Krick

Huter

Domhoff

Schmidt

Rothgang

Wolf-Ostermann

. Digital technology and nursing care: a scoping review on acceptance, effectiveness and efficiency studies of informal and formal care technologies. BMC Health Serv Res. 2019;19(1):400. doi:10.1186/s12913-019-4238-3

44.

Alsyouf

Lutfi

Alsubahi

, et al. The use of a technology acceptance model (TAM) to predict patients' usage of a personal health record system: the role of security, privacy, and usability. Int J Environ Res Publ Health. 2023;20(2):1347. doi:10.3390/ijerph20021347

45.

Kalayou

Endehabtu

Tilahun

. The applicability of the modified technology acceptance model (TAM) on the sustainable adoption of eHealth systems in resource-limited settings. J Multidiscip Healthc. 2020;13:1827-1837. doi:10.2147/JMDH.S284973

46.

Nguyen

Fujioka

Wentlandt

, et al. Using the Technology Acceptance model to explore health provider and administrator perceptions of the usefulness and ease of using technology in palliative care. BMC Palliat Care. 2020;19(1):138. doi:10.1186/s12904-020-00644-8

47.

Campbell

Gardner

Scott

Johnson

Harvey

Kazley

. Interprofessional staff perspectives on the adoption of OR black box technology and simulations to improve patient safety: a multi-methods survey. Adv Simul. 2023;8:24. doi:10.1186/s41077-023-00263-2

48.

Goldenberg

Elterman

. From box ticking to the black box: the evolution of operating room safety. World J Urol. 2020;38(6):1369-1375. doi:10.1007/s00345-019-02886-5

49.

Ramoo

Kamaruddin

Wan Nawawi

WNF

Che

Kavitha

. Nurses’ perception and satisfaction toward electronic medical record system. Florence Nightingale J Nurs. 2023;31(1):2-10. doi:10.5152/FNJN.2022.22061

Operating Room Black Box (ORBB): Examining Nurses’ Perceptions in a Surgical Setting

Abstract

Background

Methods

Results

Conclusion

Keywords

Background

Materials and Methods

Participant Recruitment

Ethical Considerations

Measurement Instruments and Procedure

Statistical Analysis

Results

Participants Characteristics

Scale Reliability

Perceptions Towards Black Box

Overall Participant Responses to Questionnaire Items

Participant Responses to Open-Ended Questions

Discussion

Limitations

Conclusion

Footnotes

ORCID iD

Author contributions

Funding

Declaration of conflicting interests

Appendix

References