A Team Performance Data Collection and Analysis System

Abstract

At present there exists no commercially available product capable of capturing and broadcasting multimedia audiovisual data from teams performing high-risk work. We have developed such a recording and analysis system for the purpose of studying team behavior, which we currently use to observe and record up to 8 people working as a co-located team in a hospital operating room. The system has four data collection computers, each recording one video stream and up to 2 audio feeds. A separate software package is used to synchronize and view the audio/video streams together on a fifth computer. This software has several annotation and scoring features which can be used either for data analysis or for team debriefing purposes. Although currently being used for patient safety research in the operating room, this system could also be adapted to collect and analyze team behavior in other domains, even for participants who are distributed.

Get full access to this article

View all access options for this article.

References

Calland

J. F.

(2001). Error Reduction During Laparoscopic Cholecystectomy. Paper presented at the American College of Surgeons Clinical Congress – Plenary Sessions, New Orleans, LA.

Campbell

Freeman

Hildebrand

(2000). Measuring the impact of advanced technologies and reorganization on human performance in a combat information center. Proceedings of the Human Factors and Ergonomics Society 44th Annual Meeting, 6, 642–645.

Cannon-Bowers

Salas

(1998). Making Decisions Under Stress: Implications for Individual and Team Training. Washington, D.C.: American Psychological Association.

Endsley

(1988). Design and evaluation for situation awareness enhancement. Proceedings of the 34th Annual Meeting of the Human Factors and Ergonomics Society, Santa Monica, CA, 97–100.

Eubanks

T. R.

Clements

R. H.

Pohl

Williams

Schaad

D. C.

Horgan

Pellegrini

(1999). An objective scoring system for laparoscopic cholecystectomy. J Am Coll Surg, 189(6), 566–574.

Gaba

D. M.

(1989). Human error in anesthetic mishaps. Int Anesthesiol Clin, 27(3), 137–147.

Helmreich

Butler

Taggart

Wilhelm

(1995). The NASA/University of Texas/FAA Line/LOS Checklist: A behavioral marker-based checklist for CRM skills assessment. Austin, TX: NASA.

Institute of Medicine. (1999). To Err is Human: Building a Safer Health System. Washington, D.C.: National Academy Press.

Leape

Brennan

Laird

Lawthers

Localio

Barnes

Hebert

Newhouse

Weiler

Hiatt

(1991). The nature of adverse events in hospitalized patients. Results of the Harvard Medial Practice Study II. The New England Journal of Medicine, 324(6), 377–384.

10.

McNeese

Salas

Endsley

(2001). New Trends in Cooperative Activities. Santa Monica, CA: HFES.

11.

Orasanu

Salas

(1995). Team decision making in complex environments. In Zsambok

, Decision Making in Action: Models and Methods (pp. 327–345). Norwood, NJ: Ablex

12.

Sanderson

Scott

Johnston

Mainzer

Watanabe

James

(1994). MacSHAPA and the enterprise of Exploratory Sequential Data Analysis (ESDA). International Journal of Human-Computer Studies, 41, 633–638.

13.

Xiao

The LOTAS Group. (2001). Understanding coordination in a dynamic medical environment: Methods and results. In Endsley

, New Trends in Cooperative Activities (pp. 242–258). Santa Monica, CA: HFES.