The problem and the solution. Holton proposed the HRD Evaluation and Research Model as a comprehensive framework for diagnosing and understanding the causal influences of HRD intervention outcomes. Unfortunately, a full test of Holton's model has not been possible because tools to measure the constructs in the model did not exist. This article reviews recent studies relevant to the constructs in Holton’s model and updates it by delineating specific constructs that should be measured in each of the conceptual categories proposed.
Alliger, G. M., & Janak, E. A. (1989). Kirkpatrick's levels of training criteria: Thirty years later. Personnel Psychology, 42, 331-342.
2.
Alliger, G. M., Tannenbaum, S. I., Bennett, W., Trave, H., & Shotland, A. (1997). A meta-analysis of the relations among training criteria. Personnel Psychology, 50(2), 341-358.
3.
Barrick, M. R., & Mount, M. K. (1991). The big five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44, 1-26.
4.
Bates, R. A., Holton, E. F., III, Seyler, D. L., & Carvalho, M. B. (2000). The role of interpersonal factors in the application of computer-based training in an industrial setting. Human Resource Development International, 3, 19-42.
5.
Bates, R. A., & Khasawneh, S. (2004). Organizational learning culture, transfer climate, and perceived innovation in Jordan. In T. M. Egan& M. L. Morris (Eds.), Proceedings of the 2004 Academy of Human Resource Development Conference(514-521). Bowling Green, OH: Academy of Human Resource Development.
6.
Bell, B. S., & Kozlowski, S.W.J. (2002). Goal orientation and ability: Interactive effects on self-efficacy, performance and knowledge. Journal of Applied Psychology, 87, 497-505.
7.
Bookter, A. I. (1999). Convergent and divergent validity of the learning transfer questionnaire. Unpublished doctoral dissertation, Louisiana State University, Baton Rouge.
8.
Chen, G., Gully, S. M., Whiteman, J. A., & Kilcullen, R. N. (2000). Examination of relationships among trait-like individual differences, state-like individual differences, and learning performance. Journal of Applied Psychology, 85, 835-847.
9.
Chen, H.-C. (2003). Cross-cultural construct validation of learning transfer system inventory in Taiwan. Unpublished doctoral dissertation, Louisiana State University, Baton Rouge.
10.
Colquitt, J. A., LePine, J. A., & Noe, R. A. (2000). Toward an integrative theory of training motivation: A meta-analytic path analysis of 20 years of research. Journal of Applied Psychology, 85, 678-707.
11.
Colquitt, J. A., & Simmering, M. J. (1998). Conscientiousness, goal orientation and motivation to learn during the learning process: A longitudinal study. Journal of Applied Psychology, 83, 654-665.
12.
Costa, P. T., & McCrae, R. R. (1992). Revised NEO personality inventory and the five-factor inventory professional manual. Odessa, FL: Psychological Assessment Resources.
13.
Costa, P. T., & McCrae, R. R. (1995). Solid ground in the wetlands of personality: A reply to Block. Psychological Bulletin, 117, 216-220.
14.
Digman, J. M. (1990). Personality structure: Emergence of the five factor model. Annual Review of Psychology, 41, 417-440.
15.
Ferguson, E., & Patterson, F. (1998). The five factor model of personality: Openness a distinct but related construct. Personality and Individual Differences, 24, 789-796.
16.
Ford, J. K., Smith, E. M., Weisbein, D. A., & Gully, S. M. (1998). Relationship of goal orientation, metacognitive activity, and practice strategies with learning outcomes and transfer. Journal of Applied Psychology, 83, 218-233.
17.
Goldberg, L. R. (1990). An alternative “description of personality”: The big-five factor structure. Journal of Personality and Social Psychology, 59, 1216-1229.
18.
Herold, D. M., Davis, W., Fedor, D. B., & Parsons, C. K. (2002). Dispositional influences on transfer of learning in multistage training programs. Personnel Psychology, 55, 851-869.
19.
Holton, E. F., III. (1996). The flawed four-level evaluation model. Human Resource Development Quarterly, 7(1), 5-21.
20.
Holton, E. F., III, Bates, R. A., & Ruona, W.E.A. (2000). Development of a generalized learning transfer system inventory. Human Resource Development Quarterly, 11(4), 333-360.
21.
Khasawneh, S. A. (2004). Construct validation of an Arabic version of the learning transfer system inventory for use in Jordan. Unpublished doctoral dissertation, Louisiana State University, Baton Rouge.
22.
Kirkpatrick, D. L. (1998). Evaluating training programs: The four levels(2 ed.). San Francisco: Berrett-Koehler.
23.
Kirkpatrick, D. (1995). Techniques for evaluating training programs. Journal of the American Society for Training and Development, 13, 3-9.
24.
LePine, J. A., Colquitt, J. A., & Erez, M. (2000). Adaptability to changing task contexts: Effects of general cognitive ability, conscientiousness, and openness to experience. Personnel Psychology, 53, 563-593.
25.
Montesino, M. U. (2002). Strategic alignment of training, transfer-enhancing behaviors, and training usage: A post training study. Human Resource Development Quarterly, 13, 89-108.
26.
Morgan, R. B., & Casper, W. J. (2000). Examining the factor structure of participant reactions to training: A multidimensional approach. Human Resource Development Quarterly, 11(3), 301-317.
27.
Naquin, S. S., & Holton, E. F., III. (2002). The effects of personality, affectivity, and work commitment on motivation to improve work through learning. Human Resource Development Quarterly, 13, 357-376.
28.
Naquin, S. S., & Holton, E. F., III. (2003). Motivation to improve work through learning in human resource development. Human Resource Development International, 6, 355-370.
29.
Noe, R. A., & Schmitt, N. (1986). The influence of trainee attitudes on training effectiveness: Test of a model. Personnel Psychology, 39, 497-523.
30.
Ruona, W.E.A., Leimbach, M., Holton, E. F., III, & Bates, R. A. (2002). The relationship between learner utility reactions and predicted learning transfer among trainees. International Journal of Training and Development, 6(4), 218-228.
31.
Seyler, D. L., Holton, E. F., III, Bates, R. A., Burnett, M. F., & Carvalho, M. B. (1998). Factors affecting motivation to transfer training. International Journal of Training and Development, 2, 2-16.
32.
Swanson, R. A., & Holton, E. F., III. (1999). Results: How to assess performance, learning and perceptions in organizations. San Francisco: Berrett-Koehler.
33.
Tan, J. A., Hall, R. J., & Boyce, C. (2003). The role of employee reactions in predicting training effectiveness. Human Resource Development Quarterly, 14, 397-411.
34.
Yamnill, S. (2001). Factors affecting transfer of training in Thailand. Unpublished doctoral dissertation, University of Minnesota, Twin Cities.
