Human Resource Development Evaluation: Emerging Market,Barriers,and Theory Building

Abstract

The problem and the solution. Measurement and evaluation (M&E) to support HRD interventions and relevant decisionmaking processes is an emerging market that has a surging demand. But the market is currently suffering from a limited supply of methodologies and techniques to address business needs. Given its distinctive nature, this market relies heavily on research to provide an array of diverse measurement theories and models that can be transformed into evaluation services for businesses. To address the limited supply of methodologies and techniques, we must conquer three barriers: the analytical barrier, the business barrier, and the technical barrier. Sprouting from an analysis of HRD systems interactions, we propose a systems approach to tackle these three barriers. This article also discusses the role of theory building and market trends in HRD M&E.

Keywords

measurement and evaluation M&E emerging market market barriers system analysis theory building

Get full access to this article

View all access options for this article.

References

Alliger, G. M. , & Janak, E. A. (1989). Kirkpatrick’s levels of training criteria: Thirty years later. Personnel Psychology, 42(2), 331-342.

Dolezalek, H. (2003). Measure for measure. Training, 40(11), 72-77.

Ehrenberg, R. G. , & Smith, R. S. (1994). Modern labor economics: Theory and public policy(5th ed.). New York: HarperCollins.

Galvin, T. (2002). The industry report 2002. Training, 39(10), 24-73.

Gujarati, D. N. (1988). Basic econometrics(2nd ed.). New York: McGraw-Hill.

Holton, E. F. (1996). The flawed four-level evaluation model. Human Resource Development Quarterly, 7, 5-21.

Judge, G. , Hill, R. , Griffiths, W. , Lutkepohl, H. , & Lee, T. (1988). Introduction to the theory and practice of econometrics(2nd ed.). New York: Wiley.

Kachigan, S. K. (1986). Statistical analysis: An interdisciplinary introduction to univariate and multivariate methods. New York: Radius Press.

Kirkpatrick, D. (1959a). Techniques for evaluating training programs. Journal of the American Society for Training and Development, 13, 3-9.

10.

Kirkpatrick, D. (1959b). Techniques for evaluating training programs: Part 2—Learning. Journal of the American Society for Training and Development, 13, 21-26.

11.

Kirkpatrick, D. (1960a). Techniques for evaluating training programs: Part 3—Behavior. Journal of the American Society for Training and Development, 14, 13-18.

12.

Kirkpatrick, D. (1960b). Techniques for evaluating training programs: Part 4—Results. Journal of the American Society for Training and Development, 14, 29-32.

13.

Kirkpatrick, D. (1998). Evaluating training programs: The four levels(2nd ed.). San Francisco: Berrett-Koehler.

14.

Maddala, G. S. (1983). Limited-dependent and qualitative variables in econometrics. New York: Cambridge University Press.

15.

Neter, J. , Wasserman, W. , & Kutner, M. H. (1990). Applied linear statistical models: Regression, analysis of variance, and experimental designs. Boston: Irwin.

16.

Nicholson, W. (1990). Microeconomic theory: Basic principles and extensions(5th ed.). Fort Worth, TX: Dryden Press.

17.

Phillips, J. (1997). Handbook of training evaluation and measurement methods(3rd ed.). Houston, TX: Gulf Publishing.

18.

Phillips, J. (2003). Return on investment in training and performance improvement programs(2nd ed.). San Francisco: Butterworth-Heinemann.

19.

Swanson, R. A. (1996). Analysis for improving performance: Tools for diagnosing organizations & documenting workplace expertise. San Francisco: Berrett-Koehler.

20.

Swanson, R. A. , & Holton, E. F. (2001). Foundations of human resource development. San Francisco: Berrett-Koehler.

21.

Twitchell, S. , Holton, E. F. , & Trott, J. W., Jr. (2000). Technical training evaluation practices in the United States. Performance Improvement Quarterly, 13, 84-109.

22.

Wang, G. G. (2002). Learning evaluation and ROI measurement: What’s the current industry status? West Chester, PA: PerformTek, LLC.

23.

Wang, G. G. , Dou, Z. , & Li, N. (2002). Asystems approach to measuring return on investment for HRD programs. Human Resource Development Quarterly, 13(2), 203-224.

24.

Wang, G. G. , & Li, J. (2003). Measuring HPT interventions: Dilemma, challenge, and solutions. Performance Improvement Quarterly, 42(10), 17-23.