Sage Journals: Discover world-class research

Abstract

Background

In any technical field, Non-Technical Skills (NTS) complement the work activity. Communication is one of these essential skills, required in any activity involving social and professional interaction. These communication skills are crucial especially in high-risk industrial environments. This collective and social NTS can be a contributing factor in many workplace accidents. Nowadays, it is becoming increasingly crucial to be able to act on this skill, starting with its diagnosis and objective assessment.

Aim

This study presents an assessment of this specific NTS through a Virtual Reality (VR) simulation. The VR scenario used involve a team solving of a collective task under time pressure. This virtual environment has been designed to match the anxiety-inducing, high-risk industrial context.

Method

N = 59 participants were included in the study and divided into 12 groups. Quantitative and qualitative data were collected to assess the overall groups’ performance. This mixed data will be analyzed and presented to compare team communication when performing a time-pressured collaborative task in an immersive environment. First, we will analyze the quantitative performance data using the k-means unsupervised clustering method guided by principal component analysis (PCA). Verbal data were then studied to account for differentiations in the communicative skills mobilized and which will characterize each of the clusters.

Results

Three distinct clusters emerged, each representing different performance patterns. Analysis of the verbal data revealed that these clusters correspond to varying levels of communication skills.

Conclusion

Virtual reality simulation is an effective tool for assessing group communication, and can be an effective training tool combined with structured debriefing.

Keywords

virtual reality assessment tool communication non-technical skills interaction team

Get full access to this article

View all access options for this article.

References

Akdere

Jiang

Acheson

(2023). To simulate or not to simulate? Comparing the effectiveness of video-based training versus virtual reality-based simulations on interpersonal skills development. Human Resource Development Quarterly, 34(4), 437-462. https://doi.org/10.1002/hrdq.21470

Arora

Miskovic

Hull

Moorthy

Aggarwal

Johannsson

Gautama

Kneebone

Sevdalis

(2011). Self vs expert assessment of technical and non-technical skills in high fidelity simulation. The American Journal of Surgery, 202(4), 500-506. https://doi.org/10.1016/j.amjsurg.2011.01.024

Bailenson

J. N.

Yee

Blascovich

Beall

A. C.

Lundblad

Jin

(2008). The use of immersive virtual reality in the learning sciences: Digital transformations of teachers, students, and social context. Journal of the Learning Sciences, 17(1), 102-141. https://doi.org/10.1080/10508400701793141

Bales

R. F.

(1950). Interaction process analysis; a method for the study of small groups (p. xi, 203). Addison-Wesley.

Belasen

A. T.

(2018). Doctor-patient communication: a review and a rationale for using an assessment framework. Journal of Health Organization and Management, 32(7), 891-907. https://doi.org/10.1108/JHOM-10-2017-0262

Bottger

P. C.

Yetton

P. W.

(1987). Improving group performance by training in individual problem solving. Journal of Applied Psychology, 72(4), 651-657. https://doi.org/10.1037/0021-9010.72.4.651

Bourrier

Jambon

Garbay

Luengo

(2017). A Multi-layered Architecture for Analysis of Non-technical-Skills in Critical Situations. André

Baker

Rodrigo

Ma. M. T.

du Boulay

(dir.), Cham (p. 463-466). https://doi.org/10.1007/978-3-319-61425-0_41

Bunderson

J. S.

Sutcliffe

K. M.

(2003). Management team learning orientation and business unit performance. Journal of Applied Psychology, 88(3), 552-560. https://doi.org/10.1037/0021-9010.88.3.552

Calder

L. A.

Mastoras

Rahimpour

Sohmer

Weitzman

Cwinn

A. A.

Hobin

Parush

(2017). Team communication patterns in emergency resuscitation: a mixed methods qualitative analysis. International Journal of Emergency Medicine, 10(1), 24. https://doi.org/10.1186/s12245-017-0149-4

10.

Campbell

Zakzanis

K. K.

Jovanovski

Joordens

Mraz

Graham

S. J.

(2009). Utilizing virtual reality to improve the ecological validity of clinical neuropsychology: An fMRI case study elucidating the neural basis of planning by comparing the tower of london with a three-dimensional navigation task. Applied Neuropsychology, 16(4), 295-306. https://doi.org/10.1080/09084280903297891

11.

Charaudeau

Maingueneau

(2002). Dictionnaire d’analyse du discours. Seuil.

12.

Chen

Zhang

Liu

Konomi

(2024). Sensing the intentions to speak in VR group discussions. Sensors, 24(2), 362. https://doi.org/10.3390/s24020362

13.

Chung

Y. H.

Yoon

W. C.

Min

(2009). A model-based framework for the analysis of team communication in nuclear power plants. Reliability Engineering & System Safety, 94(6), 1030-1040. https://doi.org/10.1016/j.ress.2008.11.010

14.

Clarke

(2006). Safety climate in an automobile manufacturing plant: The effects of work environment, job communication and safety attitudes on accidents and unsafe behaviour. Personnel Review, 35(4), 413-430. https://doi.org/10.1108/00483480610670580

15.

Corradini

Cacciari

(2002). The effect of workload and workshift on air traffic control: A taxonomy of communicative problems. Cognition, Technology & Work, 4, 229-239. https://doi.org/10.1007/s101110200021

16.

Degutyte

Astell

(2021). The role of eye gaze in regulating turn taking in conversations: A systematized review of methods and findings. Frontiers in Psychology, 12. https://doi.org/10.3389/fpsyg.2021.616471

17.

Delgoulet

Kerguelen

Barthe

(2000, 1 janvier). Vers une analyse intégrée des communications et des actions au travail: Quelles modalités de leur mise en relation ?

18.

Dmitrenko

N. Ye.

Voloshyna

O. V.

Kizim

S. S.

Mnyshenko

K. V.

Nahorniak

S. V.

(2023). Smart education in the prospective teachers’ training. CTE Workshop Proceedings, 10, 414-429. https://doi.org/10.55056/cte.568

19.

Edwards

T. C.

Soussi

Gupta

Khan

Patel

Patil

Liddle

A. D.

Cobb

J. P.

Logishetty

(2023). Collaborative team training in virtual reality is superior to individual learning for performing complex open surgery. Annals of Surgery, 278(6), 850-857. https://doi.org/10.1097/SLA.0000000000006079

20.

Falzon

(1989). Ergonomie cognitive du dialogue. Presses universitaires de Grenoble.

21.

Flin

Patey

Glavin

Maran

(2010). Anaesthetists’ non-technical skills. British Journal of Anaesthesia, 105(1), 38-44. https://doi.org/10.1093/bja/aeq134

22.

Flin

Rhona

O’Connor

(2017). Safety at the sharp end: A guide to non-technical skills. CRC Press. https://doi.org/10.1201/9781315607467

23.

Futoran

G. C.

Kelly

J. R.

et McGrath

J. E.

(1989). TEMPO: A time-based system for analysis of group interaction process. Basic and Applied Social Psychology, 10(3), 211-232. https://doi.org/10.1207/s15324834basp1003_2

24.

Gilson

L. L.

Maynard

M. T.

Jones Young

N. C.

Vartiainen

et Hakonen

(2015). Virtual Teams Research: 10 Years, 10 Themes, and 10 Opportunities. Journal of Management, 41(5), 1313-1337. https://doi.org/10.1177/0149206314559946

25.

Graneheim

U. H.

Lindgren

B.-M.

Lundman

(2017). Methodological challenges in qualitative content analysis: A discussion paper. Nurse Education Today, 56. https://doi.org/10.1016/j.nedt.2017.06.002

26.

Guttman

O. T.

Lazzara

E. H.

Keebler

J. R.

Webster

K. L. W.

Gisick

L. M.

Baker

A. L.

(2021). Dissecting communication barriers in healthcare: A path to enhancing communication resiliency, reliability, and patient safety. Journal of Patient Safety, 17(8), e1465. https://doi.org/10.1097/PTS.0000000000000541

27.

Haslam

R. A.

Hide

S. A.

Gibb

A. G. F.

Gyi

D. E.

Pavitt

Atkinson

et Duff

A. R.

(2005). Contributing factors in construction accidents. Applied Ergonomics, 36(4), 401-415. https://doi.org/10.1016/j.apergo.2004.12.002

28.

Hirst

Mann

(2004). A model of R&D leadership and team communication: the relationship with project performance. R&D Management, 34(2), 147-160. https://doi.org/10.1111/j.1467-9310.2004.00330.x

29.

Hoch

J. E.

Kozlowski

S. W. J.

(2014). Leading virtual teams: Hierarchical leadership, structural supports, and shared team leadership. Journal of Applied Psychology, 99(3), 390-403. https://doi.org/10.1037/a0030264

30.

Hsieh

H.-F.

Shannon

S. E.

(2005). Three Approaches to Qualitative Content Analysis. Qualitative Health Research, 15(9), 1277-1288. https://doi.org/10.1177/1049732305276687

31.

Ikotun

A. M.

Ezugwu

A. E.

Abualigah

Abuhaija

et Heming

(2023). K-means clustering algorithms: A comprehensive review, variants analysis, and advances in the era of big data. Information Sciences, 622, 178-210. https://doi.org/10.1016/j.ins.2022.11.139

32.

Jehn

K. A.

Mannix

E. A.

(2001). The dynamic nature of conflict: A longitudinal study of intragroup conflict and group Performance. Academy of Management Journal, 44(2), 238-251. https://doi.org/10.2307/3069453

33.

Kaplan

A. D.

Cruit

Endsley

Beers

S. M.

Sawyer

B. D.

Hancock

P. A.

(2021). The effects of virtual reality, augmented reality, and mixed reality as training enhancement methods: A meta-analysis. Human Factors, 63(4), 706-726. https://doi.org/10.1177/0018720820904229

34.

Kessel

Kratzer

Schultz

(2012). Psychological safety, knowledge sharing, and creative performance in healthcare teams. Creativity and Innovation Management, 21(2), 147-157. https://doi.org/10.1111/j.1467-8691.2012.00635.x

35.

Keyton

Wall

V. D.

(1989). Symlog: Theory and method for measuring group and organizational communication. Management Communication Quarterly, 2(4), 544-567. https://doi.org/10.1177/0893318989002004006

36.

Kleckner

M. J.

Marshall

C. R.

(2014). Critical communication skills: Developing course competencies to meet workforce needs. The Journal of Research In Business Education, 56(2), 59-81.

37.

Kleinheksel

A. J.

Rockich-Winston

Tawfik

Wyatt

T. R.

(2020). Demystifying content analysis. American Journal of Pharmaceutical Education, 84(1), 7113. https://doi.org/10.5688/ajpe7113

38.

Kurzweg

Reinhardt

Nabok

Wolf

(2021, 13 septembre). Using Body Language of Avatars in VR Meetings as Communication Status Cue. New York, NY, USA (p. 366-377). https://doi.org/10.1145/3473856.3473865

39.

La Chaire Behaviour - Chaire Behaviour. (2023, 21 novembre). https://chaire-behaviour.com/

40.

Leonard

(2004). The human factor: the critical importance of effective teamwork and communication in providing safe care. Quality and Safety in Health Care, 13(suppl_1), i85-i90. https://doi.org/10.1136/qshc.2004.010033

41.

Chi

H. L.

Wang

Chan

A. P. C.

(2018). A critical review of virtual and augmented reality (VR/AR) applications in construction safety. Automation in Construction, 86, 150-162. https://doi.org/10.1016/j.autcon.2017.11.003

42.

Lioce

Meakim

C. H.

Fey

M. K.

Chmil

J. V.

Mariani

Alinier

(2015). Standards of best practice: Simulation standard IX: simulation design. Clinical Simulation In Nursing, 11(6), 309-315. https://doi.org/10.1016/j.ecns.2015.03.005

43.

Marchand

A.-L.

(2011). Feedback systems and managing critical situations. Activités, 08(2). https://doi.org/10.4000/activites.2564

44.

Marks

M. A.

Mathieu

J. E.

Zaccaro

S. J.

(2001). A temporally based framework and taxonomy of team processes. The Academy of Management Review, 26(3), 356-376. https://doi.org/10.2307/259182

45.

Marlow

S. L.

Lacerenza

C. N.

Paoletti

Burke

C. S.

Salas

(2018). Does team communication represent a one-size-fits-all approach?: A meta-analysis of team communication and performance. Organizational Behavior and Human Decision Processes, 144, 145-170. https://doi.org/10.1016/j.obhdp.2017.08.001

46.

Md Nasir

A. N.

Farzeeha

Noordin

M. K.

Nordin

(2011, 5 mai). Technical skills and non-technical skills: predefinition concept.

47.

Moore

Geuss

Campanelli

(2019). Communicating Information in Virtual Reality: Objectively Measuring Team Performance. Chen

J. Y. C.

Fragomeni

(dir.), Cham (p. 473-489). https://doi.org/10.1007/978-3-030-21607-8_37

48.

Nassar

A. K.

Al-Manaseer

Knowlton

L. M.

Tuma

(2021). Virtual reality (VR) as a simulation modality for technical skills acquisition. Annals of Medicine and Surgery, 71, 102945. https://doi.org/10.1016/j.amsu.2021.102945

49.

Nuralievna

S. O.

(2023). Enhancing communicative competencies of future engineers: Strategies and implications. Frontline Social Sciences and History Journal, 3(05), 96-100. https://doi.org/10.37547/social-fsshj-03-05-13

50.

Orasanu

(1995). Training for Aviation Decision Making: The naturalistic decision making perspective. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 39(20), 1258-1262. https://doi.org/10.1177/154193129503902004

51.

Parsons

T. D.

Gaggioli

Riva

(2017). Virtual reality for research in social neuroscience. Brain Sciences, 7(4), 42. https://doi.org/10.3390/brainsci7040042

52.

Parush

Kramer

Foster-Hunt

McMullan

Momtahan

(2014). Exploring similarities and differences in teamwork across diverse healthcare contexts using communication analysis. Cognition, Technology & Work, 16(1), 47-57. https://doi.org/10.1007/s10111-012-0242-7

53.

Poole

M. S.

Holmes

M. E.

(1995). Decision development in computer-assisted group decision making. Human Communication Research, 22(1), 90-127. https://doi.org/10.1111/j.1468-2958.1995.tb00363.x

54.

Prineas

Mosier

Mirko

Guicciardi

(2021). Non-technical skills in healthcare. In Donaldson

Ricciardi

Sheridan

Tartaglia

et R.

(dir.), Textbook of Patient Safety and Clinical Risk Management. Springer. https://www.ncbi.nlm.nih.gov/books/NBK585613/

55.

Rash

Shi

Sussel

Smith

Thompson

Cai

Nguyen

T. D.

Cheng

Gong

Farahmand

Mehrnoush

Hosseinzadeh

Qayumi

(2024). Virtual 3D simulation technology for interprofessional team Training. Simulation & Gaming, 55(2), 281-301. https://doi.org/10.1177/10468781231222969

56.

Reason

(2000). Human error: models and management. BMJ, 320(7237), 768-770. https://doi.org/10.1136/bmj.320.7237.768

57.

Remacle

Bouchard

Etienne

A.-M.

Rivard

M.-C.

Morsomme

(2021). A virtual classroom can elicit teachers’ speech characteristics: evidence from acoustic measurements during in vivo and in virtuo lessons, compared to a free speech control situation. Virtual Reality, 25(4), 935-944. https://doi.org/10.1007/s10055-020-00491-1

58.

Robert

Dunne

Iun

(2016). The Impact of Leader Humor on Subordinate Job Satisfaction. Group & Organization Management, 41, 375-406. https://doi.org/10.1177/1059601115598719

59.

Rogalski

(1998). Concepts et méthodes d’analyse des processus de coopération dans la gestion collective d’environnements dynamiques. Dans Communications interactives dans les groupes de travail (p. 27-58). Presses Universitaires de Nancy.

60.

Rogers

C. R.

Farson

R. E.

(2015). Active Listening. Martino Publishing.

61.

Romero

Pescosolido

(2008). Humor and group effectiveness. Human Relations, 61(3), 395-418. https://doi.org/10.1177/0018726708088999

62.

Saint-Dizier De Almeida

(2014, mai). L’animation des Discussions à visée philosophique (DVP) en école primaire: Analyse de neuf DVP. https://hal.archives-ouvertes.fr/hal-01024269

63.

Salas

Goodwin

G. F.

Burke

C. S.

(dir.). (2009). Team effectiveness in complex organizations: Cross-disciplinary perspectives and approaches (p. xxxiv, 589). Routledge/Taylor & Francis Group.

64.

Salas

Reyes

McDaniel

(2018). The science of teamwork: Progress, reflections, and the road ahead. American Psychologist, 73. https://doi.org/10.1037/amp0000334

65.

Salim

Yeom

S.-Y.

Ham

D.-H.

(2024). Collecting and organizing the influencing factors of team communications to handle nuclear power plant emergencies. Applied Sciences, 14(4), 1407. https://doi.org/10.3390/app14041407

66.

Schmutz

J. B.

Meier

L. L.

Manser

(2019). How effective is teamwork really? The relationship between teamwork and performance in healthcare teams: a systematic review and meta-analysis. BMJ Open, 9(9), e028280. https://doi.org/10.1136/bmjopen-2018-028280

67.

Siassakos

Draycott

Montague

Harris

(2009). Content analysis of team communication in an obstetric emergency scenario. Journal of Obstetrics and Gynaecology, 29(6), 499-503. https://doi.org/10.1080/01443610903039153

68.

Thayer

Evans

Mcbride

A. A.

Queen

Spyridakis

(2007). Content analysis as a best practice in technical communication research. Journal of Technical Writing and Communication, 37, 267-279. https://doi.org/10.2190/TW.37.3.c

69.

Tiferes

Bisantz

A. M.

Guru

K. A.

(2015). Team interaction during surgery: a systematic review of communication coding schemes. The Journal of Surgical Research, 195(2), 422-432. https://doi.org/10.1016/j.jss.2015.02.034

70.

Trognon

Brassac

(1992). L’enchaînement conversationnel. Cahiers de linguistique française, 13, 67-108.

71.

Vespestad

M. K.

Clancy

(2020). Exploring the use of content analysis methodology in consumer research. Journal of Retailing and Consumer Services, 59, 102427. https://doi.org/10.1016/j.jretconser.2020.102427

72.

Vieira

A. M.

Santos

I. C. dos.

(2010). Communication skills: a mandatory competence for ground and airplane crew to reduce tension in extreme situations. Journal of Aerospace Technology and Management, 2, 361-370. https://doi.org/10.5028/jatm.2010.02038110

73.

Vion

(1996). L’analyse des interactions verbales. Les Carnets du Cediscor. Publication du Centre de recherches sur la didacticité des discours ordinaires, (4), 19-32. https://doi.org/10.4000/cediscor.349

74.

Von Wyl

Zuercher

Amsler

Walter

Ummenhofer

(2009). Technical and non-technical skills can be reliably assessed during paramedic simulation training. Acta Anaesthesiologica Scandinavica, 53(1), 121-127. https://doi.org/10.1111/j.1399-6576.2008.01797.x

75.

Wang

Kim

M. Jeong

Kang

S.-C.

(2013). Augmented Reality in built environment: Classification and implications for future research. Automation in Construction, 32, 1-13. https://doi.org/10.1016/j.autcon.2012.11.021

76.

Wen

Gheisari

(2020). Using virtual reality to facilitate communication in the AEC domain: a systematic review. Construction Innovation, 20(3), 509-542. https://doi.org/10.1108/CI-11-2019-0122

77.

Kaushik

(2015). Design for sustainable aging: improving design communication through building information modeling and game engine integration. Procedia Engineering, (118), 926-933. https://doi.org/10.1016/j.proeng.2015.08.532

78.

W. S.

Rouhi

A. D.

Duffy

C. C.

Ghanem

Y. K.

Williams

N. N.

Dumon

K. R.

(2024). A systematic review of immersive virtual reality for nontechnical skills training in surgery. Journal of Surgical Education, 81(1), 25-36. https://doi.org/10.1016/j.jsurg.2023.11.012

Exploring the Usability of Virtual Reality as a Tool to Assess Collective Non-Technical Skills: The Case of Team Communication During a Collaborative Task

Abstract

Background

Aim

Method

Results

Conclusion

Keywords

Get full access to this article

References