Enhancing Efficiency in Medical Simulations: The Impact of Objective Feedback on User Interface Design

Abstract

Despite central venous catheterization being a very prominent procedure, a significant portion of patients still experience complications. These complications are directly linked to the physician’s experience. To combat this problem, more advanced training is needed for residents. However, due to the mandated limited work hours of residents, the training needs to be efficient. The goal of this paper is to identify how the addition of real-time and post-performance feedback to a training simulator increases the efficiency of learning. Results show that not only does the inclusion of more feedback significantly increase the speed at which residents are able to perform, but their failure counts also decrease, indicating a higher accuracy. Therefore, integrating structured feedback into training simulators can play a key role in improving procedural competence and patient safety.

Keywords

human-computer interaction deep learning user interface design central venous catheterization medical training

Get full access to this article

View all access options for this article.

References

Accreditation Council for Graduate Medical Education. (2004). The ACGME’s approach to limit resident duty hours 12 months after implementation: A summary of achievements. https://www.acgme.org/globalassets/pfassets/publicationspapers/dh_dutyhoursummary2003-04.pdf

Brown

D. C.

Gonzalez-Vargas

J. M.

Tzamaras

H. M.

Sinz

E. H.

P. K.

Yang

M. X.

Adhikary

S. D.

Miller

S. R.

Moore

J. Z.

(2024b). Evaluating the impact of assessment metrics for simulated central venous catheterization training. Simulation in Healthcare, 19(1), 27–34. https://doi.org/10.1097/SIH.0000000000000704

Coursaris

C. K.

van Osch

(2016). A cognitive-affective model of perceived user satisfaction (CAMPUS): The complementary effects and interdependence of usability and aesthetics in IS design. Information Management, 53(2), 252–264. https://doi.org/10.1016/j.im.2015.10.003

Ejaz

Syed

Yasir

Farhan

D. F. A

., (2019). Graphic user interface design principles for designing augmented reality applications. International Journal of Advanced Computer Science and Applications, 10(2), 209–216. https://doi.org/10.14569/ijacsa.2019.0100228

Fisher

R. A.

(1934). Statistical methods for research workers (5th ed.). Oliver & Boyd.

Gonzalez-Vargas

J. M.

Brown

D. C.

Moore

J. Z.

Han

D. C.

Sinz

E. H.

Sonntag

C. C.

Miller

S. R.

(2020). Objective assessment metrics for central line simulators: An exploration of causal factors. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 64(1), 2008–2012. https://doi.org/10.1177/1071181320641487

Gonzalez-Vargas

J. M.

Sinz

Moore

J. Z.

Miller

S. R.

(2024). Clinical outcomes of standardized central venous catheterization simulation training: A comparative analysis. Journal of Surgical Education, 81(3), 444–455. https://doi.org/10.1016/j.jsurg.2023.11.022

Hung

A. J.

Zehnder

Patil

M. B.

Cai

C. K.

Aron

Gill

I. S.

Desai

M. M.

(2011). Face, content and construct validity of a novel robotic surgery simulator. Journal d'Urologie, 186(3), 1019–1024. https://doi.org/10.1016/j.juro.2011.04.064

Issenberg

S. B.

McGaghie

W. C.

Petrusa

E. R.

Lee Gordon

Scalese

R. J.

(2005). Features and uses of high-fidelity medical simulations that lead to effective learning: A BEME systematic review. Medical Teacher, 27(1), 10–28. https://doi.org/10.1080/01421590500046924

10.

James

J. T.

(2013). A new, evidence-based estimate of patient harms associated with hospital care. Journal of Patient Safety, 9(3), 122–128. https://doi.org/10.1097/PTS.0b013e3182948a69

11.

Jamshidi

(2019). Central venous catheters: Indications, techniques and complications. Seminars in Pediatric Surgery, 28(1), 26–32. https://doi.org/10.1053/j.sempedsurg.2019.01.005

12.

Kaul

Brown

Moore

J. Z.

Miller

S. R.

(2024). Design of a sensorized original syringe (SOS) for a training system for central venous catheterization [Conference session]. 2024 Design of Medical Devices Conference.

13.

Kollerup

N. K.

Johansen

S. S.

Tolsgaard

M. G.

Friis

M. L.

Skov

M. B.

van Berkel

(2024). Clinical needs and preferences for AI-based explanations in clinical simulation training. Behaviour & Information Technology, 44(5), 954–974. https://doi.org/10.1080/0144929X.2024.2334852

14.

Makary

M. A.

Daniel

(2016). Medical error-the third leading cause of death in the us.. BMJ, 353, i2139. https://doi.org/10.1136/bmj.i2139

15.

Mann

H. B.

Whitney

D. R.

(1947). On a test of whether one of two random variables is stochastically larger than the other. Annals of Mathematical Statistics, 18(1), 50–60. https://doi.org/10.1214/aoms/1177730491

16.

McGee

D. C.

Gould

M. K.

(2003). Preventing complications of central venous catheterization. New England Journal of Medicine, 348(12), 1123–1133. https://doi.org/10.1056/NEJMra011883

17.

McKinley

R. K.

Strand

Ward

Gray

Alun-Jones

Miller

(2008). Checklists for assessment and certification of clinical procedural skills omit essential competencies: A systematic review. Medical Education, 42(4), 338–349. https://doi.org/10.1111/j.1365-2923.2007.02970.x

18.

Merrer

De Jonghe

Golliot

Lefrant

J.-Y.

Raffy

Barre

Rigaud

J. P.

Casciani

Misset

Bosquet

Outin

Brun-Buisson

Nitenberg

(2001). Complications of femoral and subclavian venous catheterization in critically ill patients: A randomized controlled trial. Journal of the American Medical Association, 286(6), 700–707. https://doi.org/10.1001/jama.286.6.700

19.

Nakić

Kosović

I. N.

Franić

(2022). User-centered design as a method for engaging users in the development of geovisualization: A use case of temperature visualization. Applied Sciences, 12(17), 8754. https://doi.org/10.3390/app12178754

20.

Pepley

Yovanoff

Mirkin

Miller

Han

Moore

(2016). A virtual reality haptic robotic simulator for central venous catheterization training. Journal of Medical Devices, 10(3), 0309371–0309372. https://doi.org/10.1115/1.4033867

21.

Pepley

D. F.

Gordon

A. B.

Yovanoff

M. A.

Mirkin

K. A.

Miller

S. R.

Han

D. C.

Moore

J. Z.

(2017). Training surgical residents with a haptic robotic central venous catheterization simulator. Journal of Surgical Education, 74(6), 1066–1073. https://doi.org/10.1016/j.jsurg.2017.06.003

22.

Segall

Bennett-Guerrero

(2016). Should checklists for central venous catheter insertion be used in training, credentialing, or routine clinical care? Critical Care Medicine, 44(10), 1943–1944. https://doi.org/10.1097/ccm.0000000000001935

23.

Shernoff

E. S.

Von Schalscha

Gabbard

J. L.

Delmarre

Frazier

S. L.

Buche

Lisetti

(2020). Evaluating the usability and instructional design quality of interactive virtual training for teachers (IVT-T). Educational Technology Research and Development, 68(6), 3235–3262. https://doi.org/10.1007/s11423-020-09819-9

24.

Soffler

M. I.

Hayes

M. M.

Smith

C. C.

(2018). Central venous catheterization training: Current perspectives on the role of simulation. Advances in Medical Education and Practice, 9, 395–403. https://doi.org/10.2147/AMEP.S142605

25.

Sznajder

J. I.

Zveibil

F. R.

Bitterman

Weiner

Bursztein

(1986). Central vein catheterization: Failure and complication rates by three percutaneous approaches. Archive of Internal Medicine, 146(2), 259–261. https://doi.org/10.1001/archinte.1986.00360140065007

26.

Taylor

R. W.

Palagiri

A. V.

(2007). Central venous catheterization. Critical Care Medicine, 35(5), 1390–1396. https://doi.org/10.1097/01.CCM.0000260241.80346.1B

27.

Teja

Bosch

N. A.

Diep

Pereira

T. V.

Mauricio

Sklar

M. C.

Sankar

Wijeysundera

H. C.

Saskin

Walkey

Wijeysundera

D. N.

Wunsch

(2024). Complication rates of central venous catheters: A systematic review and meta-analysis. JAMA Internal Medicine, 184(5), 474–482. https://doi.org/10.1001/jamainternmed.2023.8232

28.

Troianos

C. A.

Hartman

G. S.

Glas

K. E.

Skubas

N. J.

Eberhardt

R. T.

Walker

J. D.

Reeves

S. T.

(2011). Guidelines for performing ultrasound guided vascular cannulation: Recommendations of the American Society of Echocardiography and the Society of Cardiovascular Anesthesiologists. Journal of the American Society of Echocardiography, 24(12), 1291–1318. https://doi.org/10.1016/j.echo.2011.09.021

29.

Tzamaras

H. M.

Brown

Gonzalez-Vargas

Moore

Miller

S. R.

(2024). Evaluating the effects of comprehensive simulation on central venous catheterization training: A comparative observational study. BMC Medical Education, 24, 745. https://doi.org/10.1186/s12909-024-05661-2

30.

Tzamaras

H. M.

Brown

D. C.

Gonzalez-Vargas

J. M.

Moore

J. Z.

Miller

S. R.

(2022). Slow and steady: Examining the impact of hands-on instructions on learnability of a training simulator to enhance development of core skills in central venous catheterization. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 66(1), 1867–1871. https://doi.org/10.1177/1071181322661243

31.

Wanzel

K. R.

Ward

Reznick

R. K.

(2002). Teaching the surgical craft: From selection to certification. Current Problems in Surgery, 39(6), 573–659. https://doi.org/10.1067/mog.2002.123481

32.

H. L.

Brown

Miller

Moore

(2023). Deploying computer vision detection method in medical simulation training using machine learning [Conference session]. 2023 Design of Medical Devices Conference.