Sage Journals: Discover world-class research

Abstract

Background

Current team assessment instruments in healthcare tend to involve rater-based evaluations that are susceptible to well-known biases. Recent advances in technology include portable devices to measure team-based activities. Consequently, the possibility exists to move away from rater-based assessments of team function by identifying quantitative measures to replace them.

Aim

This article aims to provide potential approaches to developing quantitative measurement suites involving large amounts of data to address the challenges of assessment presented by the complex nature of teamwork.

Conclusion

By addressing construct, measurement, and context components, we provide a practical approach to developing a suite to capture quantitative measurements that, through incorporation of social network analysis and aggregated other values, aligns with the Team Strategies & Tools to Enhance Performance and Patient Safety^TM (TeamSTEPPS^TM) dimensions for fostering teamwork.

Keywords

teamwork assessment social network analysis team performance healthcare teams tool development

Get full access to this article

View all access options for this article.

References

Agency for Healthcare Research and Quality . (2019, June). About TeamSTEPPS^TM. https://www.ahrq.gov/teamstepps/about-teamstepps/index.html

Agha

R. A.

Fowler

A. J.

Sevdalis

(2015). The role of non-technical skills in surgery. Annals of Medicine and Surgery, 4(4), 422–427. https://doi.org/10.1016/j.amsu.2015.10.006.

Baker

W. E.

(2000). Teams as networks: Using network analysis for team development. https://www.kellogg.northwestern.edu/faculty/uzzi/ftp/restricted/teams%20as%20networks.pdf.

Bell

S. T.

Brown

S. G.

Colaneri

Outland

(2018). Team composition and the ABCs of teamwork. American Psychologist, 73(4), 349–362. https://doi.org/10.1037/amp0000305.

Carboni

Ehrlich

(2013). The effect of relational and team characteristics on individual performance: A social network perspective. Human Resource Management, 52(4), 511–535. https://doi.org/10.1002/hrm.21539.

Chaffin

Heidl

Hollenbeck

J. R.

Howe

Voorhees

Calantone

(2017). The promise and perils of wearable sensors in organizational research. Organizational Research Methods, 20(1), 3–31. https://doi.org/10.1177/10944281 15617004.

Cordeiro

Sarmento

R. P.

Brazdil

Gama

(2018). Evolving Networks and Social Network Analysis Methods and Techniques. In Social Media and Journalism. Visnovsky J & Radosinska J. Intech Open. Chapter 7. http://dx.doi.org/10.5772/intechopen.79041.

George

Osinga

E. C.

Lavie

Scott

B. A.

(2016). Big data and data science methods for management research: From the Editors. Academy of Management Journal, 59(5), 1493–1507. https://doi.org/10.5465/amj.2016.4005

Higham

Greig

P. R.

Rutherford

Vincent

Young

Vincent

(2019). Observer-based tools for non-technical skills assessment in simulated and real clinical environments in healthcare: A systematic review. BMJ Quality & Safety, 28(8), 672–686. https://doi.org/10.1136/bmjqs-2018-008565.

10.

Hoang

T. N.

LaPorta

A. J.

Malone

J. D.

Champagne

Lavell

De La Rosa

G. M.

Gaul

Dukovich

(2019). Hyper-realistic and immersive surgical simulation training environment will improve team performance. Trauma Surgery & Acute Care Open, 5(1), e000393. https://doi.org/10.1136/tsaco-2019-000393.

11.

Javidmehr

Ebrahimpour

(2015). Performance appraisal bias and errors: The influences and consequences. International Journal of Organizational Leadership, 4(3), 286–302. https://doi.org/10.33844/ijol.2015.60464

12.

Kash

B. A.

Cheon

Halzack

N. M.

Miller

T. R.

(2018). Measuring team effectiveness in the health care setting: an inventory of survey tools. Health Services Insights, 11(11), 1–18. https://doi.org/10.1177/11786329 18796230.

13.

Kayhan

V. O.

Chen

French

K. A.

Allen

T. D.

Salomon

Watkins

(2018). How honest are the signals? A protocol for validating wearable sensors. Behavior Research Methods, 50(1), 57–83. https://doi.org/10.3758/s13428-017-1005-4.

14.

Kolbe

Boos

(2019). Laborious but elaborate: The benefits of really studying team dynamics. Frontiers in Psychology, 10, 1478. https://doi.org/10.3389/fpsyg.2019.01478.

15.

Kondrasuk

J. A.

(2011). So what would an ideal performance appraisal look like? Journal of Applied Business and Economics, 12(1), 57–71.

16.

Kozlowski

S. W. J.

Chao

G. T.

(2018). Unpacking team process dynamics and emergent phenomena: Challenges, conceptual advances, and innovative methods. American Psychologist, 73(4), 576–592. https://doi.org/10.1037/amp0000245.

17.

Luciano

M. M.

Mathieu

J. E.

Park

Tannenbaum

S. I.

(2018). A fitting approach to construct and measurement alignment: The role of big data in advancing dynamic theories. Organizational Research Methods, 21(3), 592–623. https://doi.org/10.1177/10944281 17728372.

18.

McCormack

R. K.

Kilcullen

Sinatra

A. M.

Brown

Beaubien

(2018). Towards validating a Mission Command Team Training Model in GIFT for Military Populations. In Proceedings of the 6th Annual GIFT Users Symposium (GIFTSym6), Orlando, May 2018, (pp. 188–198). R. A. U.S. Army Research Laboratory.

19.

Orvis

K. L.

DeCostanza

A. H.

Duchon

(2013). Developing systems-based performance measures: A rational approach. In The interservice/industry training, simulation and education conference. (I/ITSEC, no. 1).

20.

Paige

J. T.

Garbee

D. D.

Kozmenko

Yang

Bonanno

Swartz

(2014). Getting a head start: High fidelity, simulation-based operating room team training of interprofessional students. Journal of the American College of Surgeons, 218(1), 140–149. https://doi.org/10.1016/j.jamcollsurg.2013.09.006.

21.

Peng

Anton

N. E.

Cha

Mizota

Hennings

J. M.

Stambro

Rendina

M. A.

Stanton-Maxey

K. J.

Stefanidis

(2019). Objective measures of communication behavior predict clinical performance. Journal of Surgical Education, 76(5), 1337–1347. https://doi.org/10.1016/j.jsurg.2019.03.017.

22.

Praca

G. M.

Lima

B. B.

Bredt

S. D. G. T.

Sousa

R. B. E.

Clemente

F. M.

de Andrade

A. G. P.

(2019). Influence of match status on players’ prominence and teams’ network properties during 2018 FIFA world cup. Frontiers in Psychology, 10, 695. https://doi.org/10.3389/fpsyg.2019.00695.

23.

Pype

Mertens

Helewaut

Krystallidou

(2018). Healthcare teams as complex adaptive systems: understanding team behavior through team members’ perception of interpersonal interaction. BMC Health Services Research, 18(1), 570. https://doi.org/10.1186/s12913-018-3392-3.

24.

Rosen

M. A.

Dietz

A. S.

Yang

Priebe

C. E.

Pronovost

P. J.

(2015). An integrative framework for sensor-based measurement of teamwork in healthcare. Journal of the American Medical Informatics Association: JAMIA, 22(1), 11–18. https://doi.org/10.1136/amiajnl-2013-002606.

25.

Salas

Cooke

N. J.

Rosen

M. A.

(2008). On teams, teamwork, and team performance: Discoveries and developments. Human Factors, 50(3), 540–547. https://doi.org/10.1518/001872008X288457.

26.

Sullivan

Saatchi

Younis

Harris

M. L.

(2019). Diffusion of knowledge and behaviours among trainee doctors in an acute medical unit and implications for quality improvement work: A mixed methods social network analysis. BMJ Open, 9(12), e027039. https://doi.org/10.1136/bmjopen-2018-027039.

27.

Tabassum

Pereira

F. S. F.

Fernandes

Gama

(2018). Social network analysis: An overview. WIREs Data Mining and Knowledge Discovery, 8(1), e1256. https://doi.org/10.1002/widm.1256.

28.

Uher

(2020). Measuring in metrology, psychology and social sciences: data generation traceability and numerical traceability as basic methodological principles applicable across sciences. Quality & Quantity, 54(1), 975–1004. https://doi.org/10.1007/s11135-20-00970-2.

29.

Villamane

Larranaga

Alvarez

(2017). Rating monitoring as a means to mitigate rater effects and controversial evaluations. In Proceedings of 5th International Conference on Technological Ecosystems for Enhancing Multiculturality, Cadiz, Spain, 18–20 October, 2017, (pp. 7). https://doi.org/10.1145/3144826.3145389.

30.

Ward

D. R.

Ghali

W. A.

Graham

Lemaire

J. B.

(2014). A real-time locating system observes physician time-motion patterns during walk-rounds: A pilot study. BMC Medical Education, 14(1), 37. https://doi.org/10.1186/1472-6920-14-37.

31.

Welsch

L. A.

Hoch

Poston

R. D.

Parodi

V. A.

Akpinar-Elci

(2018). Interprofessional education involving didactic TeamSTEPPS(R) and interactive healthcare simulation: A systematic review. Journal of Interprofessional Care, 32(6), 657–665. https://doi.org/10.1080/13561820.2018.1472069.

32.

Widaman

K. F.

(2020). Objective measurement of subjective phenomena in (OBSSR), editor, OBSSR online resource for behavioral and social sciences research. In OBSSR e-Source online (Ed.), Office of behavioral and social sciences research. http://www.esourceresearch.org/eSourceBook/ObjectiveMeasurementofSubjectivePhenomena/11AuthorBiography/tabid/722/Default.aspx.

33.

Wind

S. A.

(2019). Examining the impacts of rater effects in performance assessments. Applied Psychological Measurement, 43(2), 159–171. https://doi.org/10.1177/0146621618789391.

Conceptualizing a Quantitative Measurement Suite to Evaluate Healthcare Teams

Abstract

Background

Aim

Conclusion

Keywords

Get full access to this article

References