Abstract
Background:
The handover and associated shift start checks by nurses of critical care patients are complex and prone to errors. However, which aspects lead to errors remains unknown. Fewer errors might occur in a structured approach. We hypothesized that specific gaze behavior during handover and shift start safety check correlates with error recognition.
Methods:
In our observational eye tracking study, we analyzed gaze behavior of critical care nurses during handover and shift start safety check in a simulation room with built-in errors. Four areas of interest (AOI) were pre-defined (patient, respirator, prescriptions, monitor). The primary outcome were different gaze metrics (time to first fixation, revisits, first visual intake duration, average visual intake duration, dwell time) on AOIs. Parameters were analyzed by taking all errors in account, and by dividing them into minor and critical.
Results:
Forty-three participants were included. All participants committed at least a minor error (
Conclusion:
Error detection during shift start safety check was associated with distinct gaze behavior. Nurses who recognized more errors had a shorter time to first fixation and less revisits. These gaze characteristics might correspond to a more structured approach. Further research is necessary, for example by implementing a checklist, to reduce errors in the future and improve patient safety.
Introduction
An effective handover is considered one of the “nine patient safety solutions” according to the World Health Organization (WHO). 1 It is a core skill for intensive care unit (ICU) nurses and doctors, and is prone to many errors such as loss of important clinical information by either failure to convey or failure to recognize existing problems. 2 However, no uniform guidelines or training recommendations exist. Handover within the ICU involves transfer of responsibility of care of complex and critically ill patients when patients are being admitted to or discharged from the ICU or during shift handover. It is a frequent but challenging task. Deficiency of communication or miscommunication in this process both can lead to professional dissatisfaction, increase health care costs, and compromise patient safety. 3
Efforts to standardize that process have increased in recent years, ranging from numerous mnemonic tools to system-based approaches or checklists. 4 Many of these reported standardized handover protocols have been shown to improve professional satisfaction, reduce technical errors, and improve retention of information,5,6 which has led to increased support for their use.7 –9 However, the level of implementation, adherence and training in this area remain low and uncertain. 4 As such, appropriate training for handover has also been proposed in order to ensure its quality. 10 Handover is often plagued by errors in or inadequate communication. Its completeness is often affected by time pressure, distractions, and inappropriate surroundings, which in turn causes information loss and even critical errors.11,12 It has been shown that up to 50% of clinical information is either not conveyed or not retained after handover amongst staff intensivists, which further emphasized the importance of communication strategies such as checklists, as well as brief clinical examinations. 13 The burden of an inadequate handover may be associated with key patient information being lost and treatment plans being missed. Undoubtedly, the consequence of those in the complex and vulnerable ICU patient population may become catastrophic. Another study has found that handover without using checklists is associated with more than 60% loss in information compared with using them. 14
In general, most existing studies focus merely on conveying information and communication during handover. However, there is no objective measure of how much clinical information is retained or whether potential critical errors are recognized by clinical examination during handover and subsequent shift start safety checks. The novel technology of eye tracking might be a suitable tool to analyse gaze behavior during handover as it gives insight into areas of interest associated with complex tasks. This can be helpful since the handover and shift start safety checks are very heterogeneous inter-individually as no clear guidelines exist. 3 Eye tracking involves the analysis of ocular and pupilar movements by using infra-red light reflected by the cornea and detected by recording cameras. 15 Distinct gaze metrics provide indices to assess visual behavior of participants. The technology minimizes effects related to expected behavior, while revealing objective information relating to gaze behavior that conventional observations normally miss. 15 As a substantial part of the cognitive information processed by health professionals at the bedside is visual information, the role of eye movements during the execution of complex tasks becomes particularly important. 16 In previous research, eye tracking has been proven to be a helpful tool to assess gaze behavior in different ICU settings, contributing to a more profound understanding of complex situations during the treatment of patients and of possible sources of human errors.17 –19 To our knowledge, eye tracking has however not been used for research in the setting of handovers and shift start safety checks, which may also be prone to the occurrence of potentially harmful errors.
In this study, we thus used eye tracking to analyze gaze behaviors of ICU nurses during a handover with a shift start safety check. We hypothesized that specific gaze behavior correlates with error recognition during the safety check.
Methods
Study design and study population
This was a prospective, simulated, observational single-center study at the tertiary hospital ICU of the Cantonal hospital of St. Gallen, Switzerland. The participants consisted of a random sample of adult ICU nurses working at the ICU. Participation was voluntary, the recruitment was conducted orally. The participants had to be either certified ICU nurses, ICU nurse in training or certified intermediate care nurses. The time of work experience and the specific professional role on the ICU were recorded and included in the statistical analyses. To prevent influence on behavior, the participants were not informed about the nature and purpose of the study. The local Ethics Committee approved the study protocol (Ethikkommission Ostschweiz, BASEC Nr. 2023-01130, approval date 21.09.2023, study title (german): Untersuchung grundlegender visueller Verhaltensmuster und Einflüsse auf das visuelle Verhalten in der Akutmedizin (Intensiv-Anästhesie und Notfallmedizin) im Rahmen ihrer professionellen Tätigkeit im simulierten Setting). The study was performed in accordance with the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards. Based on other comparable eye tracking research, a target sample size of 25–30 participants was considered adequate.20 –22
Simulation room and errors
The simulation room was equipped with a mannequin (Lifecast Body Simulation London UK Adult mannequin) set up as an ICU patient including vital parameter monitoring and diverse diagnostic and therapeutic installations (vital parameter monitoring, compression stockings, peripheral and central venous lines, extra ventricular drainage). Further it included a handout specifying the medical conditions of the patient and a prescription sheet. The fictive 50-year-old female patient was hospitalized for a spontaneous subarachnoid hemorrhage after endovascular aneurysm treatment (coil embolization of the arteria cerebri posterior). An extraventricular drainage (EVD) was placed to prevent intracerebral hypertension. The previously healthy patient was allergic to metamizole and was lactose intolerant. An overview of the simulation setting is shown in Figure 1.

Overview of the simulation setting. The five critical and the five minor errors are shown (red circles). Detailed descriptions of the errors can be found in Figure 2.
We incorporated five critical and five minor errors based on real safety hazards that had happened at the ICU and had been reported in the Critical Incident Reporting System (CIRS). We classified errors as “critical” when they were considered as potentially lethal in the shortest term (e.g. blood group incompatibility) and as “minor” when the potential harm to the patient was not immediate (e.g. lactose containing yogurt despite lactose intolerance). A detailed overview of the different errors is shown in Figure 2.

Detailed description of the five critical and the five minor errors.
Procedure
The goal was to observe each participating ICU nurse performing a shift start safety check on a mannequin. To later correlate the observation with gaze behavior, we equipped the participants with an eye tracker. The selected ICU nurses were invited to the simulation room and were asked to fill in a questionnaire on demographics, work qualifications, and specific questions on errors and preparation relating to shift handover.
Thereafter, they received the patient’s case history (described in “simulation room and errors”). In our clinical routine, a shift handover consists of an initial verbal handover and a subsequent visual check of the patient and the ICU environment. To generate robust standardized data on gaze behavior, we focused on the handover check at the bedside (i.e. shift start safety check) and dispensed with a verbal handover. This was replaced by a short, written handover in order to create comparable starting conditions for all participants.
To record the gaze behavior during the task, they were equipped with the SMI eye tracking glasses wireless system 2, as described below. Eye tracking recordings started after a standardized three-point calibration and the participants read the case history and stood in front of the mannequin. For the shift start safety check, the participants had a maximum of 15 min at their disposal. They completed the task alone. Recognized errors were immediately communicated to an observer who was present in the room. Recordings ended when participants subjectively completed the task and handed back the eye tracker to the observer. After the recording, the participants filled in a survey on questions concerning subjective restrictions of the eye tracker in movement or visibility, stress experienced during the task and personal perception of how fast they recognized potential errors. The survey is attached to the paper (Supplemental File 1).
Data collection
We recorded eye tracking data using the SMI eye tracking glasses 2 wireless system (Sensomotoric Instruments, Teltow, Germany). The system simultaneously records angle of view with an accuracy of the 0.5° and a view of the scene with a resolution of 960x720 px at 30 frames per second (fps). We analyzed the raw data with the SMI Be-Gaze 3.7 software with its analysis algorithm for gaze patterns. Subjective data on baseline characteristics and personal experience of the participant were collected using questionnaires.
Data analysis
We analyzed the gaze behavior recorded by the eye tracker and the registered errors. For gaze fixation analysis, we defined four specific areas of interest (AOI) prior to the test according to a local shift handover guideline of the ICU (patient, monitor, ventilator, prescriptions). Fixations irrelevant to the study (e.g. fixation on the floor, surroundings, roofs etc.) were classified as “not relevant” and not included in the analysis.
Outcome
We hypothesized that the participants who recognized more errors had a different gaze behavior during shift start safety check. To challenge this hypothesis, we studied the different gaze characteristics and matched them with the number of recognized errors communicated to the observer during the test. The primary outcome was time to first fixation for all AOIs (time until the AOI was fixated for the first time). Secondary outcomes were revisits (number of repeated fixations to an AOI), first visual intake duration (time spent on an AOI during first fixation), average visual intake duration (average time spent on an AOI across all fixations), and dwell time (cumulated time spent on an AOI including blinks and saccades). The above-mentioned terms are summarized in Supplemental File 2.
The different gaze parameters were analyzed for all errors (critical and minor) and for critical errors only.
Statistics
Data were modeled by means of binomial generalized linear mixed-effects models, considering the presence of a mistake in an AOI as dependent variables, and the eye-tracking measurements as fixed effects while accounting for subject ICU experience as fixed effect and subject and AOI as random effects. Logarithmical transformations were employed for non-normally distributed effects.
Results
Participants
In total, 49 ICU nurses were included in the study, of which six dropped out due to inaccurate recordings such as insufficient calibration or incomplete/erroneous fixation recording. Of the 43 remaining participants, 33 (77%) were female. Role and professional qualification of the included participants are presented in Table 1. Median general professional experience was 194 months [IQR 123–279] and median ICU experience was 72 months [IQR 33–192], respectively (Table 1).
Baseline characteristics of included ICU nurses (
Categorical numbers are reported as absolute numbers and percentages (with percentages in brackets). Continuous data are reported as median and interquartile range (with interquartile ranges in square brackets).
Critical and minor errors
In Table 2, occurrence of errors (critical and minor errors) during the safety check is characterized. While all participants committed at least a minor error (
Occurrence of critical and minor errors.
Categorical numbers (i.e. number of participants committing errors) are reported as absolute numbers and percentages (with percentages in brackets). Continuous data (i.e. number of errors) are reported as median and interquartile range (with interquartile ranges in square brackets).
Refers to the median number of missed errors per participant. A missed error was defined as a safety hazard that was not recognized by the participant.
Gaze metrics on all errors
Time to First Fixation (ms), Revisits (
Mixed model analysis
In the mixed model analysis taking all errors (critical and minor) into account, it became apparent that the odds ratios of missing errors differed according to specific eye tracking gaze metrics (Figure 3). While a longer time to First Fixation or more Revisits were associated with increased odds ratios (OR) for missing errors (Time to First Fixation: OR 1.099 (95% CI 1.023–1.191,

Mixed model analysis taking all errors (critical and minor) into account. The odds ratio (OR) of error and 95% confidence interval (CI) are shown for time to first fixation, first visual intake duration, average visual intake duration, dwell time, and revisits.
In the mixed model analysis restricted to only critical errors (Figure 4), similar results as in the analysis considering all missed errors could be obtained. The OR of missing critical errors increased with higher Time to Fixation (OR 1.095 (95% CI 1.018–1.196,

Mixed model analysis taking only critical errors into account. The odds ratio (OR) of error and 95% confidence interval (CI) are shown for time to first fixation, first visual intake duration, average visual intake duration, dwell time, and revisits.
Questionnaires
According to the questionnaires, 40 participants (93%) have previously made a mistake during a handover or safety check. 28 (65%) prepare their shift handover. The stress level from a scale from 1 to 10 during the simulation was low (3 [IQR 33–192]). The subjective disturbance by the device during the procedure was rated neglectable. The eye tracker interfered only mildly in mobility (4 [IQR 2–6] and work [IQR 1–5]), on a scale from 1 (no interference) to 10 (maximal interference). No critical incidents occurred during the measurements.
Discussion
In this study, we observed the gaze behavior of critical care nurses at handover with a focus on shift start safety check in a simulated setting. The main results strengthen our hypothesis that specific gaze behavior correlates with error recognition. The risk of error occurrence increased with time to first fixation in both analyses (overall errors and critical errors only). Thus, the correct detection of errors was associated with shorter duration of time to fixation. Longer dwell times were associated with less missed errors. There was no difference in gaze behavior between more experienced and less experienced staff in the detection of errors.
We used the eye-tracking tool to better understand the relationship between identification of critical errors during shift start safety check and the associated gaze behavior of ICU nurses, where comparable studies focusing on eye movements do not exist to our knowledge. While conventional observations frequently are associated with biases such as observation biases, 23 the technology of eye tracking in contrast can offer objective gaze metrics in various settings including critical care.24 –27 For example, eye tracking has previously been shown to effectively quantify the visual attention amongst critical care professionals performing daily bedside practice. 28 The method can also be successfully used to minimize the occurrence of the Hawthorne effect, which overestimates compliance of professionals in settings where they are directly observed. 29 Our present study was able to present an in-depth characterization of visual patterns during a shift start safety check, which would not be possible with other conventional methodologies of observation. As one of our main results, we found that the risk of overlooking an error during shift safety check increased with a higher time to first fixation. This finding is highly plausible since it took ICU nurses longer to identify the relevant AOI and thus to detect the corresponding errors. Moreover, longer dwell times, first intake durations and average visual intake durations were associated with less unrecognized errors in the overall analysis. In the context of our study design, we assume that those gaze metrics (i.e. Dwell time, first intake duration, and average visual intake duration) are an expression of accurate cognitive detection of errors. The longer participants gazed at distinct AOIs, the more likely they were to detect and identify the corresponding errors. It is plausible that the opposite (i.e. shorter overall dwell times and average visual intake times) would have led to missing more errors, as the errors simply might have been overlooked and visually disregarded. Interestingly, more revisits were associated with not recognizing more errors in the overall analysis. We explain this finding as an expression of the fact that participants struggled to detect the corresponding errors at first hand and thus frequently revisited AOIs, without drawing any consequences or recognizing the associated errors. In contrast, if an error once has been detected, no more revisits to the corresponding AOIs would have probably been necessary, which in turn leads to decreased revisit numbers.
In the analysis including only critical errors, we found comparable results to the overall analysis. Longer fixations (i.e. dwell time, first visual intake duration, and average visual intake duration) also have been associated with missing less critical errors. Especially for the detection of critical errors, longer attention seems necessary to visually grasp those errors and cognitively process them. In contrast to the overall analysis, more revisits were however associated with missing less critical errors. In previous eye tracking research, revisits have been characterized as a surrogate of re-checks, monitoring, and control glances.30,31 This finding thus could be explained by the fact that participants frequently re-checked AOIs with associated critical errors, even if the error already had been detected before. Such re-checks and verification blinks might have direct clinical consequences during the treatment of the patient, especially with regard to critical errors that potentially compromise patient safety (such as e.g. pump rates at perfusors or dosages of medications with effects on the circulation). The technology of eye tracking thus can provide highly precise assessments and crystallize relevant visual patterns during processes that are associated with increased risks for ICU patients. This would not be possible with pure conventional observations. Eye tracking should thus be used to investigate handovers and safety checks on the ICU more in detail. It could be used to develop checklists and standardized processes during handover procedures. Previous studies have made a similar observation in high-risk events (e.g. ICU patient transfers) and have shown that standardized handover protocols and preparation time reduced safety errors and information retainment. This led to increased professional satisfaction whilst handover time did not change significantly. However, further improvement and the development of such structured approaches is needed to systematically reduce safety hazards in the future.5,6,14,32,33
In a sub analysis comparing more and less experienced staff, we found no differences according to experience level, which is an interesting finding that we did not expect. More expertise and longer professional experience in the ICU apparently did not lead to lower error rates, even after long years of working in the field. Several possible reasons could explain this finding. On the one hand, more experienced staff simply might rely on their own subjective approaches at shift start safety checks and perform according to their own, long-established routine, which might prone them to incur errors and overlook relevant details. New trainees might be trained to approach their patients in a structured way, possibly leading to standardized procedures during handover and safety checks. The combination of those might have led to our observation and the lacking differences. On the other hand, we can’t rule out residual confounders owing to limited participant numbers, heterogenous levels of experience, and professional functions within our cohort, or statistical underpowering. Nevertheless, our findings highlight that also more, experienced and older staff need frequent training and teaching sessions, be it in real-life or in simulation rooms.
Our study has several strengths, including its novelty and innovative design. We provided comparable conditions in every observation by exposing each participant to the same setup. Moreover, we created conditions close to reality by using a clinical case based on previous CIRS cases that happened in real-life. From a methodological point of view, the participants were only instructed to perform a handover and shift start safety check, and they did not know if and how many errors were hidden, which might have enhanced reality and minimized biases. We could also exclude stress (a well-known factor affecting performance) as a biasing influence using a standardized questionnaire.
The study also has to account for some limitations. The number of participants was relatively limited and the study was conducted in a single center design. Larger study populations might thus overcome potential associated biases and shed more light on the direct impact of gaze behavior on error detection. Moreover, the study was conducted in a simulated scenario. The utilization of our findings in a real clinical setting might thus be difficult. However, other research has demonstrated elevated error rates within simulations, underscoring the potential impact of simulation findings for clinicians in real-life.34,35 All participants were working in the same hospital, probably limiting external validity. It would be interesting to observe critical care nurses from different centers to evaluate if they perform differently.
This study assessed two aspects of the handover and shift start safety check. The first aspect was the case presentation and the second part the subsequent safety check procedure. Different performances of the first part might thus have had impacts on the subsequent checking procedure, which our study did not account for. Furthermore, different institutions might have differing protocols for handovers and safety checks. Thus, our assumption that checks for errors are made during handover (as is routinely performed at our institution) may not be generalizable to other institutions. In addition, our selection of errors – despite being based on real errors reported in our CIRS – might be biased to some extent.
In conclusion, our results show that error detection during a shift start safety check was associated with distinct gaze behavior of ICU nurses. The gaze characteristics of the participants who recognized more errors fit to a more structured approach. Our study implicates that transition to real-life eye tracking studies are an important next step to refine and further validate our findings. In this way, checklists could eventually be developed or guidelines generated for organized and safe handovers in ICUs. Moreover, future studies in real environments should investigate whether structured handovers can directly minimize the occurrence of human errors. This would be an important next step to improve patient safety in critical care.
Supplemental Material
sj-docx-1-inc-10.1177_17511437241268160 – Supplemental material for Eye tracking during a simulated start of shift safety check: An observational analysis of gaze behavior of critical care nurses
Supplemental material, sj-docx-1-inc-10.1177_17511437241268160 for Eye tracking during a simulated start of shift safety check: An observational analysis of gaze behavior of critical care nurses by Yael van der Geest, Ivan Chau, Pedro David Wendel-Garcia, Philipp K Buehler, Wolf Hautz, Miodrag Filipovic, Daniel A Hofmaenner and Urs Pietsch in Journal of the Intensive Care Society
Footnotes
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
Ethics
The local Ethics Committee approved the study protocol (Ethikkommission Ostschweiz, BASEC Nr. 2023-01130, approval date 21.09.2023, study title (german): Untersuchung grundlegender visueller Verhaltensmuster und Einflüsse auf das visuelle Verhalten in der Akutmedizin (Intensiv-Anästhesie und Notfallmedizin) im Rahmen ihrer professionellen Tätigkeit im simulierten Setting). The study was performed in accordance with the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards.
Supplemental material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
