The Impact of Different Feedback Types on Decision-Making in Simulation Based Training Environments

Abstract

The performance of complex decision-making requires not only domain specific knowledge, but also a clear understanding of how to accurately make decisions. It is our belief that when training decision-making skills, feedback type will play an important role in increasing learning gains. In an attempt to understand this relationship, we investigated the effects of three types of feedback (process, outcome, and normative) on the task performance of college students within a complex, real time, computer based simulation. We collected data from 48 participants. Data analyses showed a statistically significant difference between groups. Specifically, the results revealed that participants who received process feedback outperformed participants who received normative feedback, outcome feedback, and a no feedback (control) condition. The implications of these results for optimal feedback delivery methods within scenario based training environments will be discussed.

Get full access to this article

View all access options for this article.

References

Balzer

W. K.

Doherty

M. E.

O'Connor

(1989). Effects of cognitive feedback on performance. Psychological Bulletin, 106, 410–433.

Bolton

A. E.

(2006). Immediate versus delayed feedback in simulation based training: Matching feedback delivery timing to the cognitive demands of the training exercise. Unpublished doctoral dissertation, University of Central Florida.

Buff

W. L.

Campbell

G. E.

(2002). What to do or what not to do?: Identifying the content of effective feedback. Proceedings of the 46th Annual Meeting of the Human Factors and Ergonomics Society, (p. 2074–2078). Santa Monica, CA: HFES.

Eitelman

Owens

Fowlkes

Nelson

Walwanis M.

Atkinson

B. W.

(2006). Instructional strategies for exercise manipulation in distributed mission training. Proceedings of the 28th Interservice/Industry Training Simulation & Education Conference, Orlando, FL [CD-ROM].

Ericsson

K. A.

Krampe

R. T.

Tesch-Romer

(1993). The role of deliberate practice in the acquisition of expert performance. Psychological Review, 100, 363–406.

Fullick

Smith-Jentsch

Miller

(2008). An empirical investigation of the three-factor goal orientation model, self-monitoring, and local of control. Unpublished manuscript.

Gaudine

A. P.

Saks

A. M.

(2001). Effects of an absenteeism feedback intervention on employee absence behavior. Journal of Organizational Behavior, 22, 15–29.

Geary

D.C.

DeSoto

M.C.

(2001). Sex differences in spatial abilities among adults from the United States and China: Implications for an evolutionary theory. Evolution and Cognition, 7(2), 172–177.

Gilbert

M. K.

Hutchison

C. R.

Cusimano

M. D.

Regehr

(2000). A computer-based trauma simulator for teaching trauma management skills. The American Journal of Surgery, 179, 223–228.

10.

Gilman

D. A.

(1970). Comparison of several feedback methods for correcting errors by computer-assisted instruction. Journal of Educational Psychology, 60, 503–508.

11.

Ilgen

D. R.

Fisher

C. D.

Taylor

M. S.

(1979). Consequences of individual feedback on behavior in organizations. Journal of Applied Psychology, 64, 349–371.

12.

Kluger

A. N.

DeNisi

(1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119, 254–284.

13.

Salas

Cannon-Bowers

J. A.

(1997). Methods, tools, and strategies for team training. In Quinones

M. A.

Ehrenstein

(Eds.), Training for a rapidly changing workplace: Applications of psychological research (p. 249–279). Washington, DC: American Psychological Association.

14.

Shute

(2007). Focus on formative feedback (RR-07–11). Princeton, NJ: Educational Testing Service. Retrieved from http://www.ets.org/Media/Research/pdf/RR-07-11.pdf.

15.

Smither

J. W.

Wohlers

A. J.

London

(1995). A field study of reactions to normative versus individualized upward feedback. Group & Organization Management, 20, 61–89.

16.

Y. L.

Lin

D. Y. M.

(1998). The impact of expert system-based training on calibration of decision confidence in emergency management. Computers in Human Behavior, 14, 181–194.

17.

Wiggins

O'Hare

(2003). Weatherwise: Evaluation of a cue-based training approach for the recognition of deteriorating weather conditions during flight. Human Factors, 45, 337–345.