Performance measurement research has characteristically focused on the performance of individuals and has not addressed the measurement of teamwork skills. Dyer Suggested that this lack of teamwork measures presents serious problems for conducting team-oriented research because research efforts are often judged by the quality of the measurement device employed. In an effort to assess and advance the science of measuring teamwork, the current review examines the measurement of teamwork skills on theoretical, methodological, and psychometric grounds. Furthermore, we present a series of general principles to guide research in the future. Although some progress has been made, there is still much to be learned about the measurement of teamwork.
Get full access to this article
View all access options for this article.
References
1.
Alexander, L. T., and Cooperland, A. S. (1965). System training and research in team behavior (TM-2581; DTIC No. AD620606). Santa Monica, CA: System Development Corporation.
2.
Bass, B. M. (1980). Individual capability, team performance, and team productivity. In E. A. Fleishman and M. D. Dunnette (Eds.), Human performance and productivity (pp. 179–232). Hillsdale, NJ: Erlbaum.
3.
Boguslaw, R., and Porter, E. H. (1962). Team functions and training. In R. M. Gagne (Ed.), Psychological principles in system development (pp. 387–416). New York: Holt, Rinehart & Winston.
4.
Brannick, M. T., Roach, R. M., and Salas, E. (1991, April). Understanding team performance: A multimethod study. Paper presented at the Sixth Annual Conference of the Society for Industrial and Organizational Psychology, St. Louis, MO.
5.
Briggs, G. E., and Naylor, J. C. (1964). Experiments on team training in a CIC-type environment. (NAVTRADEVCEN Tech. Report 1327-1). Port Washington, NY: U.S. Naval Training Device Center.
6.
Campbell, D. T., and Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81–105.
7.
Cannon-Bowers, J. A., and Salas, E. (1990, April). Cognitive psychology and team training: Shared mental models in complex systems. Paper presented at the Fifth Annual Meeting of the Society for Industrial and Organizational Psychology, Miami, FL.
8.
Driskell, J. E., and Salas, E. (1991). Group decision making under stress. Journal of Applied Psychology, 76, 473–478.
9.
Dyer, J. L. (1984). Team research and training: A state of the art review. Human Factors Review, 285–323.
10.
Foushee, H. C. (1984). Dyads and triads at 35,000 feet. American Psychologist, 39, 885–893.
11.
Glickman, A. S., Zimmer, S., Montero, R. C., Guerette, P. J., Campbell, W. J., Morgan, B. B., and Salas, E. (1987). The evolution of teamwork skills: An empirical assessment with implications for training (Tech. Report 87-016). Orlando, FL: Naval Training Systems Center, Human Factors Division.
12.
Helmreich, R. L., Chidester, T. R., Foushee, H. C., Gregorich, S., and Wilhelm, J. A. (1989). How effective is cockpit management training? Issues in evaluating the impact of programs to enhance crew coordination (NASA/UT Tech. Report 89-2). Moffett Field, CA: NASA-Ames Research Center.
13.
Klaus, D. L., and Glaser, R. (1968). Increasing team proficiency through training: 8. Final summary report (ONR Contract 2551 [00] [Nr 154-079]). Bedford, MA: American Institutes for Research, Team Training Laboratory.
14.
Lanzetta, J. Y., and Roby, T. B. (1960). The relationship between certain group process variables and group problem-solving efficiency. Journal of Social Psychology, 52, 135–148.
15.
Marrow, A. J. (1969). The practical theorist: The life and work of Kurt Lewin.New York: Basic Books.
16.
Meister, D. (1985). Behavioral analysis and measurement methods.New York: Wiley.
17.
Morgan, B. B., Glickman, A. S., Woodward, E. A., Blaiwes, A. S., and Salas, E. (1986). Measurement of team behaviors in a Navy environment (Tech. Report TR-86-014). Orlando, FL: Naval Training Systems Center, Human Factors Division.
18.
Nieva, V. F., Fleishman, E. A., and Reick, A. (1978). Team dimensions: Their identity, their measurement, and relationships (Final Tech. Report, Contract DAH19-78-C-0001). Washington, DC: Advanced Resources Research Organization.
19.
Oser, R., McCallum, G. A., Salas, E. and Morgan, B. B. (1989). Toward a definition of teamwork: An analysis of critical team behaviors (Tech. Report 89-004). Orlando, FL: Naval Training Systems Center, Human Factors Division.
20.
Prince, C., Salas, E., and Franz, T. M. (1990, June). Aircrew coordination performance and skill development. Paper presented at the 1990 Symposium on Independent Research/Independent Exploratory Development, Baltimore, MD.
21.
Roby, T. B. (1957). On the measurement and description of groups. Behavioral Science. 2, 119–127.
22.
Salas, E., Blaiwes, A. S., Reynolds, R. E., Glickman, A. S., and Morgan, B. B. (1985). Teamwork from team training: New directions. In Proceedings of the 7th Interservice/Industry Training Equipment Conference and Exhibition (pp. 400–406). Orlando, FL: American Defense Preparedness Association.
23.
Salas, E., Dickinson, T. L., Converse, S., and Tannenbaum, S. I. (1992). Toward an understanding of team performance and training. In R. W. Swezey and E. Salas (Eds.), Teams: Their training and performance (pp. 3–29). Norwood, NJ: Ablex.
24.
Schiflett, S., Eisner, E. J., Price, S. J., and Schemmer, M. (1985). The definition and measurement of small military unit team functions (Research Report 1397). Fort Benning, GA: Training Research Laboratory, ARI Field Unit.
25.
Siskel, K., and Flexman, R. (1962). Study of the effectiveness of a flight simulator for training complex aircrew skills. Bell Aeronautics.
26.
Smith, P. C., and Kendall, I. M. (1963). Retranslation of expectations: An approach for the construction of unambiguous anchors for rating scales. Journal of Applied Psychology, 47, 149–155.
27.
Vreuls, D., and Obermayer, R. W. (1985). Human-system performance measurement in training simulators. Human Factors, 27, 241–250.
