Human error is an ever-present threat to the safe conduct of flight. Recently, applied psychologists have developed an intervention, crew resource management (CRM) training, designed to help prevent human error in the cockpit. However, as it is commonly applied within the aviation community, CRM lacks standardization in content, design, delivery, and evaluation. This paper presents a discussion of an applied program of research aimed at developing a methodology for the design and delivery of CRM training within the Navy. This long-term, theoretically based program of aviation team research included identification of skills to be trained, development of performance measures, application of instructional design principles, and evaluation of the training delivery. Our conclusion indicates that a systematic methodology for developing CRM training can result in better performance in the cockpit. Actual or potential applications of this research include any task environment in which teams are interdependent.
Get full access to this article
View all access options for this article.
References
1.
Baker, D. P., Prince, C., Shrestha, L., Oser, R. L., & Salas, E. (1993). Aviation computer games for crew resource management training. International Journal of Aviation Psychology, 3(2), 143–156.
2.
Baker, D. P., & Salas, E. (1992). Principles for measuring teamwork skills. Human Factors, 34, 469–475.
3.
Beard, R. L., Salas, E., & Prince, C. (1995). Enhancing transfer of training: Using role-play to foster teamwork in the cockpit. International Journal of Aviation Psychology, 5(2), 131–143.
4.
Bowers, C. A., Baker, D. P., & Salas, E. (1994). Measuring the importance of teamwork: The reliability and validity of job/task analysis indices for team-training design. Military Psychology, 6, 205–214.
5.
Bowers, C. A., Deaton, J., Oser, R. L., Prince, C., & Kolb, M. (1995). Impact of automation on aircrew communication and decision-making performance. International Journal of Aviation Psychology, 5(2), 145–168.
6.
Bowers, C. A., Morgan, B. B., Jr., & Salas, E. (1991). The assessment of aircrew coordination demand for helicopter flight requirements. In Proceedings of the 6th International Symposium on Aviation Psychology (pp. 308–313). Mahwah, NJ: Erlbaum.
7.
Bowers, C. A., Morgan, B. B., Jr., Salas, E., & Prince, C. (1993). Assessment of coordination demand for aircrew coordination training. Military Psychology, 5, 95–112.
8.
Bowers, C. A., Thornton, C., Braun, C. C., & Salas, E. (1998). Automation, task difficulty, and aircrew performance. Military Psychology, 10, 259–274.
9.
Brannick, M. T., Prince, C., Salas, E., & Stout, R. J. (1997). Development and evaluation of a team training tool. Unpublished manuscript.
10.
Brannick, M. T., Salas, E., & Prince, C. (Eds.). (1997). Team performance assessment and measurement: Theory, methods, and applications.Mahwah, NJ: Erlbaum.
11.
Byrnes, R. E., & Black, R. (1993). Developing and implementing CRM programs: The Delta experience. In E. L. Wiener, B. G. Kanki, & R. L. Helmreich(Eds.), Cockpit resource managementa (pp. 421–443). San Diego: Academic.
12.
Cannon-Bowers, J. A., Prince, C., Salas, E., Owens, J. M., Morgan, B. B., Jr., & Gonos, G. H. (1989). Determining aircrew coordination effectiveness. In Proceedings of the 11th Interservice/Industry Training Systems Conference (pp. 128–136). Arlington, VA: National Defense Industrial Association.
13.
Cannon-Bowers, J. A., & Salas, E. (1997). Teamwork competencies: The intersection of team member knowledge, skills, and attitudes. In H. F. O'Neil (Ed.), Workforce readiness: Competencies and assessment.Mahwah, NJ: Erlbaum.
14.
Cannon-Bowers, J. A., & Salas, E. (1998). Individual and team decision making under stress: Theoretical underpinnings. In J. A. Cannon-Bowers & E. Salas(Eds.), Making decisions under stress: Implications for individual and team training (pp. 17–38). Washington, DC: American Psychological Association.
15.
Cannon-Bowers, J. A., Tannenbaum, S. I., Salas, E., & Converse, S. A. (1991). Toward an integration of training theory and technique. Human Factors, 33, 281–292.
16.
Cannon-Bowers, J. A., Tannenbaum, S. I., Salas, E., & Volpe, C. E. (1995). Defining team competencies and establishing team training requirements. In R. Guzzo & E. Salas(Eds.), Team effectiveness and decision-making in organizations (pp. 333–380). San Francisco: Jossey-Bass.
17.
Caro, P. W. (1988). Flight training and simulation. In E. L. Wiener & D. C. Nagel(Eds.), Human factors in aviation (pp. 229–261). San Diego: Academic.
18.
Chidester, T. R., & Foushee, H. C. (1988). Leader personality and crew effectiveness: Factors influencing performance in full-mission air transport simulation. In Proceedings of the 66th Meeting of the Aerospace Medical Panel on Human Stress Situations in Aerospace Operations (pp. 7-1–7-9). The Hague, Netherlands: Advisory Group for Aerospace Research and Development.
19.
Dwyer, D. J., Fowlkes, J. E., Oser, R. L., Salas, E., & Lane, N. E. (1997). Team performance measurement in distributed environments: The TARGETs methodology. In M. T. Brannick, E. Salas, & C. Prince(Eds.), Team performance assessment and measurement: Theory, methods, and applications (pp. 137–153). Mahwah, NJ: Erlbaum.
20.
Endsley, M. R. (1995). Measurement of situation awareness in dynamic systems. Human Factors, 37, 65–84.
21.
Ford, J. K., Kozlowski, S. W. J., Kraiger, K., Salas, E., & Teachout, M. S. (Eds.) (1997). Improving training effectiveness in work organizations. Mahwah, NJ: Erlbaum.
22.
Foushee, H. C. (1984). Dyads and triads at 35,000 feet: Factors affecting group process and aircrew performance. American Psychologist, 39, 885–893.
23.
Foushee, H. C., & Helmreich, R. L. (1988). Group interaction and flight crew performance. In E. L. Wiener & D. C. Nagel(Eds.), Human factors in aviation (pp. 189–227). San Diego: Academic.
24.
Fowlkes, J. E., Dwyer, D. J., Oser, R. L., & Salas, E. (1998). Event-based approach to training. International Journal of Aviation Psychology, 8(3), 209–221.
25.
Fowlkes, J. E., Lane, N. E., Salas, E., Franz, T., & Oser, R. L. (1994). Improving the measurement of team performance: The TARGETs methodology. Military Psychology, 6, 47–61.
26.
Hartel, C., Smith, K. A., & Prince, C. (1991). Defining aircrew coordination: Searching mishaps for meaning. Paper presented at the 6th International Symposium on Aviation Psychology, Columbus, OH.
27.
Helmreich, R. L., & Foushee, H. C. (1993). Why crew resource management? Empirical and theoretical bases of human factors training in aviation. In E. L. Wiener, B. G. Kanki, & R. L. Helmreich(Eds.), Cockpit resource management (pp. 3–45). San Diego: Academic.
28.
Helmreich, R. L., & Wilhelm, J. A. (1991). Outcomes of crew resource management training. International Journal of Aviation Psychology, 1(4), 287–300.
29.
Jentsch, F. (1997). Meta-cognitive training for junior team members: Solving the copilots catch-22. Unpublished doctoral dissertation, University of Central Florida, Orlando.
30.
Jentsch, F., & Bowers, C. A. (1998). Evidence of validity of low-fidelity simulations in studying aircrew coordination. International Journal of Aviation Psychology, 8(3), 243–260.
31.
Johnston, J. H., Cannon-Bowers, J. A., & Smith-Jentsch, K. A. (1995). Event-based performance measurement system for shipboard command teams. In Proceedings of the 1st International Symposium on Command and Control Research and Technology (pp. 274–276). Washington, DC: Department of Defense.
32.
Kolb, D. A. (1984). Experiential learning: Experience as the source of learning and development.Englewood Cliffs, NJ: Prentice-Hall.
33.
Lauber, J. K. (1984). Resource management in the cockpit. Air Line Pilot, 53, 20–23.
34.
Leedom, D. K., & Simon, R. (1995). Improving team coordination: A case for behavior based training. Military Psychology, 7, 109–122.
35.
Marrow, A. J. (1969). The practical theorist: The life and work of Kurt Lewin.New York: Basic Books.
36.
McIntyre, R. M., & Salas, E. (1995). Measuring and managing for team performance: Emerging principles from complex environments. In R. Guzzo & E. Salas(Eds.), Team effectiveness and decision making in organizations (pp. 149–203). San Francisco: Jossey-Bass.
37.
Morgan, B. B., Jr., Salas, E., & Glickman, A. S. (1994). An analysis of team evolution and maturation. Journal of General Psychology, 120, 277–291.
38.
Orasanu, J. L. (1993). Decision-making in the cockpit. In E. L. Wiener, B. G. Kanki, & R. L. Helmreich(Eds.), Cockpit resource management (pp. 137–172). San Diego: Academic.
39.
Oser, R. L., Dwyer, D. J., & Folkes, J. E. (1995). Team performance in multi-service distributed interactive simulation exercises: Initial results. In Proceedings of the 17th Interservice/Industry Training Systems and Education Conference (pp. 163–171). Arlington, VA: National Defense Industrial Organization.
40.
Pettit, M. A., & Dunlap, J. H. (1997). Cockpit leadership and followership skills: Theoretical perspectives and training guidelines (Tech. Report). Washington, DC: Federal Aeronautics Administration.
41.
Prince, A., Brannick, M. T., Prince, C., & Salas, E. (1997). The measurement of team process behaviors in the cockpit: Lessons learned. In M. T. Brannick, E. Salas, & C. Prince(Eds.), Team performance assessment and measurement (pp. 289–310). Mahwah, NJ: Erlbaum.
42.
Prince, C., Oser, R., Salas, E., & Woodruff, W. (1993). Increasing hits and reducing misses in CRM/LOS scenarios: Guidelines for simulator scenario development. International Journal of Aviation Psychology, 3(1), 69–82.
43.
Prince, C., & Salas, E. (1989). Aircrew performance: Coordination and skill development. In D. E. Daniel, E. Salas, & D. M. Kotick(Eds.), Independent research and independent exploratory development (IR/IED) programs: Annual report for fiscal year 1988 (NTSC Tech. Report 89-009). Orlando, FL: Naval Training Systems Center.
44.
Prince, C., & Salas, E. (1993). Training and research for teamwork in the military aircrew. In E. L. Wiener, B. G. Kanki, & R. L. Helmreich(Eds.), Cockpit resource management (pp. 337–366). San Diego: Academic.
45.
Ryle, G. (1949). The concept of mind.Chicago: University of Chicago Press.
46.
Salas, E., Bowers, C. A., & Cannon-Bowers, J. A. (1995). Military team research: Ten years of progress. Military Psychology, 7, 55–75.
47.
Salas, E., & Cannon-Bowers, J. A. (1997). Methods, tools, and strategies for team training. In M. A. Quiñones & A. Ehrenstein(Eds.), Training for a rapidly changing workplace: Applications of psychological research (pp. 249–279). Washington, DC: American Psychological Association.
48.
Salas, E., & Cannon-Bowers, J. A. (in press). The anatomy of team training. In L. Tobias & D. Fletcher(Eds.), Handbook on research in training.New York: Macmillan.
49.
Salas, E., Cannon-Bowers, J. A., & Blickensderfer, E. L. (1997). Enhancing reciprocity between training theory and practice: Principles, guidelines, and specifications. In J. K. Ford, S. W. J. Kozlowski, K. Kraiger, E. Salas, & M. S. Teachout(Eds.), Improving training effectiveness in work organizationsa (pp. 291–322). Mahwah, NJ: Erlbaum.
50.
Salas, E., Cannon-Bowers, J. A., & Johnston, J. H. (1997). How can you turn a team of experts into an expert team? Emerging training strategies (pp. 359--370). In C. Zsambok & G. Klein(Eds.), Naturalistic decision making.Mahwah, NJ: Erlbaum.
51.
Salas, E., Dickinson, T. L., Converse, S. A., & Tannenbaum, S. I. (1992). Toward an understanding of team performance and training. In R. W. Swezey & E. Salas(Eds.), Teams: Their training and performance (pp. 3–29). Norwood, NJ: Ablex.
52.
Salas, E., Fowlkes, J. E., Stout, R. J., Milanovich, D., & Prince, C. (in press). Does CRM training improve teamwork skills in the cockpit?: Two evaluation studies. Human Factors.
53.
Salas, E., Prince, C., Baker, D. P., & Shrestha, L. (1995). Situation awareness in team performance: Implications for measurement and training. Human Factors, 37, 123–136.
54.
Shrestha, L. B., Prince, C., Baker, D. P., & Salas, E. (1995). Understanding situation awareness: Concepts, methods, and training. In W. B. Rouse (Ed.), Human/technology interaction in complex systems (Vol. 7, pp. 45–83). Greenwich, CT: JAI Press.
55.
Smith-Jentsch, K. A., Salas, E., & Baker, D. (1996). Training team performance-related assertiveness. Personnel Psychology, 49, 909–936.
56.
Smith-Jentsch, K., Zeisig, R. L., Acton, B., & McPherson, J. (1998). Team dimensional training: A strategy for guided team self-correction. In J. A. Cannon-Bowers & E. Salas(Eds.), Making decisions under stress: Implications for individual and team training (pp. 271–297). Washington, DC: American Psychological Association.
57.
Stone, R. B., & Babcock, G. L. (1988). Airline pilots' perspective. In E. L. Wiener & D. C. Nagel(Eds.), Human factors in aviation (pp. 529–560). San Diego: Academic.
58.
Stout, R. J., Cannon-Bowers, J. A., & Salas, E. (1996). The role of shared mental models in developing team situational awareness: Implications for training. Training Research Journal, 2, 85–116.
59.
Stout, R. J., Salas, E., & Fowlkes, J. E. (1997). Enhancing teamwork in complex environments through team training. Group Dynamics: Theory, Research, & Practice, 1, 169–182.
60.
Stout, R. J., Salas, E., & Kraiger, K. (1997). The role of trainee knowledge structures in aviation team environments. International Journal of Aviation Psychology, 7(3), 235–250.
61.
Swezey, R., Llaneras, R., Prince, C., & Salas, E. (1991). Instructional strategy for aircrew coordination training. In Proceedings of the 6th International Symposium on Aviation Psychology (pp. 302–307). Mahwah, NJ: Erlbaum.
62.
Swezey, R. W., & Salas, E. (1992). Guidelines for use in team-training development. In R. W. Swezey & E. Salas(Eds.), Teams: Their training and performance (pp. 219–245). Norwood, NJ: Ablex.
63.
Tannenbaum, S. I., Beard, R. L., & Salas, E. (1992). Team building and its influence on team effectiveness: An examination of conceptual and empirical developments. In K. Kelley (Ed.), Issue, theory, and research in industrial/organizational psychology (pp. 117–153). Amsterdam: Elsevier.
64.
Thornton, C., Braun, C. C., Bowers, C. A., & Morgan, B. B., Jr. (1992). Automation effects in the cockpit: A low-fidelity investigation. In Proceedings of the Human Factors and Ergonomics Society 36th Annual Meeting (pp. 30–34). Santa Monica, CA: Human Factors and Ergonomics Society.
65.
Wiener, E. L., Kanki, B. G., & Helmreich, R. L. (Eds.). (1993). Cockpit resource management.San Diego: Academic.
66.
Yamamori, H., & Mito, T. (1993). Keeping CRM is keeping the flight safe. In E. L. Wiener, B. G. Kanki, & R. L. Helmreich, Cockpit resource management (pp. 399–420). San Diego: Academic.
