A review of the evaluation literature shows that there has been a resurgence of interest in the evaluation of management development programs by human resource development (HRD) professionals. However, there remains a question of how well evaluation models measure the achievement of intended outcomes, especially where the program goal is the enhancement of organizational performance. This article analyzes management development interventions from 1986 to 2000 through a results assessment lens to determine common evaluation characteristics in organizational performance improvement efforts. The implication of factors such as timing of evaluation, evaluation methods, management development intervention categories, instrumentation, and measurement of organizational performance are discussed in this manuscript. Findings reveal that HRD professionals must take the leadership in the development of evaluation activities, especially those that test the long-term impact of the intervention on the organization.
Get full access to this article
View all access options for this article.
References
1.
Alliger, G. M.
, Tannenbaum, S. I., Bennett, W., Traver, H., & Shotland, A. (1997). A meta-analysis of the relations among training criteria. Personnel Psychology, 50, 341-359.
2.
Avolio, B. J.
, & Howell, J. M. (1992). The impact of leadership behavior and leader-follower personality match on satisfaction and unit performance. In K. E. Clark, M. B. Clark, & D. P. Campbell (Eds.), Impact of leadership (pp. 225-236). Greensboro, NC: Center for Creative Leadership.
3.
Baker, D. E.
, Walsh, M. B., & Marjerison, L. (2000). High-performance leadership at the process level. In E. F. Holton & S. S. Naquin (Eds.), Developing high-performance leadership competency. San Francisco: Berrett-Koehler.
4.
Barling, J.
, Weber, T., & Kelloway, E. K. (1996). Effects of transformational leadership training on attitudinal and financial outcomes: A field experiment. Journal of Applied Psychology, 81, 827-832.
5.
Bates, R. A.
(1999). Measuring performance improvement. Advances in Developing Human Resources, 1, 47-67.
6.
Berry, J. K.
(1990, August). Linking management development to business strategies. Training and Development, pp. 20-21.
7.
Brungardt, C.
(1996). The making of leaders: A review of the research in leadership development and education. The Journal of Leadership Studies, 3(3), 81-95.
8.
Burke, M. J.
, & Day, R. R. (1986). A cumulative study of the effectiveness of managerial training. Journal of Applied Psychology, 71, 242-245.
9.
Byham, W. C.
(1999). Grooming next-millennium leaders. HR Magazine, 44(2), 46-51.
10.
Campbell, J. P.
(1988). Training design for productivity improvement. In J. P. Campbell & R. J. Campbell (Eds.), Productivity in organizations (pp. 171-215). San Francisco: Jossey-Bass.
11.
Carlisle, K. E.
, & Henrie, D. (1993, August). Are you doing high-impact HR?Training and Development, pp. 47-53.
12.
Clark, K. E.
, Clark, M. B., & Campbell, D. P. (1992). The impact of leadership. Greensboro, NC: Center for Creative Leadership.
13.
Collins, D. B.
(2000). Organizational performance: The future focus of leadership development. Journal of Leadership Studies, 7(4), 43-54.
14.
Collins, D. B.
, Lowe, J. S., & Arnett, C. R. (2000). High-performance leadership at the organizational level. In E. F. Holton & S. S. Naquin (Eds.), Developing high-performance leadership competency. San Francisco: Berrett-Koehler.
15.
Dionne, P.
(1996). The evaluation of training activities: A complex issue involving different stakes. Human Resource Development Quarterly, 7, 279-286.
16.
Friedman, T. L.
(2000). The Lexus and the olive tree. New York: Anchor.
17.
Fullagar, P. K.
(1992). The impact of institutional financial performance on executive succession in higher education. In K. E. Clark, M. B. Clark, & D. P. Campbell (Eds.), Impact of leadership (pp. 495-504). Greensboro, NC: Center for Creative Leadership.
18.
Fulmer, R. M.
, & Wagner, S. (1999). Leadership: Lessons from the best. Training and Development, 53(3), 28-33.
19.
Garavan, T. N.
, Barnicle, B., & O’Suilleabhain, F. (1999). Management development: Contemporary trends, issues and strategies. Journal of European Industrial Training, 23(14-15), 191-191.
20.
Gibler, D.
, Carter, L., & Goldsmith, M. (2000). Best practices in leadership development handbook. San Francisco: Jossey-Bass.
21.
Glynn, M. A.
, & Slepian, J. (1992). Leaders and transitions: The role of leadership in corporate name change. In K. E. Clark, M. B. Clark, & D. P. Campbell (Eds.), Impact of leadership (pp. 305-312). Greensboro, NC: Center for Creative Leadership.
22.
Goldstein, I. L.
(1986). Training in organizations: Needs assessment, design, and evaluation. Monterey, CA: Brooks-Cole.
23.
Gordon, J.
(1987, June). Romancing the bottom line. Training, pp. 31-42.
24.
Holton, E. F., III
. (1996). The flawed four-level evaluation model. Human Resource Development Quarterly, 7(1), 5-21.
25.
Holton, E. F., III
, & Naquin, S. S. (2000). Developing high-performance leadership competency. San Francisco: Berrett-Koehler.
26.
Howell, J. M.
, & Avolio, B. J. (1993). Transformational leadership, transactional leadership, locus of control, and support for innovation: Key predictors of consolidated business-unit performance. Journal of Applied Psychology, 78, 891-902.
27.
Kirkpatrick, D. L.
(1996). Invited reaction: Reaction to Holton article. Human Resources Development Quarterly, 7, 5-15.
28.
Koene, B. A. S.
, Pennings, J. M., & Schreuder, H. (1992). Leadership, organizational culture, and organizational outcomes. In K. E. Clark, M. B. Clark, & D. P. Campbell (Eds.), Impact of leadership (pp. 215-224). Greensboro, NC: Center for Creative Leadership.
29.
Kraiger, K.
, Ford, J., & Salas, E. (1993). Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. Journal of Applied Psychology, 75, 311-328.
30.
Lohmann, D.
(1992). The impact of leadership on corporate success: A comparative analysis of the American and Japanese experience. In K. E. Clark, M. B. Clark, & D. P. Campbell (Eds.), Impact of leadership (pp. 59-80). Greensboro, NC: Center for Creative Leadership.
31.
Lynham, S. A.
, & Swanson, R. A. (1997). The development and evaluation of a model of responsible leadership for performance: Beginning the journey. Proceedings of the 1997 Annual Conference for the Academy of Human Resource Development, pp. 570-577.
32.
McCauley, C. D.
, Moxley, R. S., & Van Velsor, E. (1998). The center for creative leadership handbook of leadership development. San Francisco: Jossey-Bass.
33.
Moller, L.
, & Mallin, P. (1996). Evaluation practices of instructional designers and organizational supports and barriers. Performance Improvement Quarterly, 9(4), 82-92.
34.
Moxnes, P.
, & Eilertsen, D. (1991). The influence of management training upon organizational climate: An exploratory study. Journal of Organizational Behavior, 12, 399-411.
35.
Murphy, J. P.
, & Settich, J. F. (1992). Taking the measure of leadership impact: How leaders share values in Catholic higher education. In K. E. Clark, M. B. Clark, & D. P. Campbell (Eds.), Impact of leadership (pp. 365-378). Greensboro, NC: Center for Creative Leadership.
36.
Olian, J. D.
, Durham, C. C., Kristoff, A. L., Brown, K. G., Pierce, R. M., & Kunder, L. (1998). Designing management training and development for competitive advantage: Lessons from the best. Human Resource Planning, 21(1), 20-33.
37.
Penwell, L. W.
(1992). The impact of leaders on group and intergroup dynamics in teleconferences between interdependent work teams. In K. E. Clark, M. B. Clark, & D. P. Campbell (Eds.), Impact of leadership (pp. 477-486). Greensboro, NC: Center for Creative Leadership.
38.
Phillips, J. J.
(1997). Handbook of training evaluation and measurement methods. Houston, TX: Gulf.
39.
Riechmann, D.
(1992). High-involvement, high-performance teams in higher education: The impact of leadership. In K. E. Clark, M. B. Clark, & D. P. Campbell (Eds.), Impact of leadership (pp. 257-268). Greensboro, NC: Center for Creative Leadership.
40.
Rummler, G. A.
, & Brache, A. P. (1995). Improving performance: How to manage the white space on the organization chart. San Francisco: Jossey Bass.
41.
Sashkin, M.
, Rosenbach, W. E., Deal, T. E., & Peterson, K. D. (1992). Assessing transformational leadership and its impact. In K. E. Clark, M. B. Clark, & D. P. Campbell (Eds.), Impact of leadership (pp. 131-148). Greensboro, NC: Center for Creative Leadership.
42.
Schein, E. H.
(1990, Summer). Organization development and the study of organizational culture. Academy of Management OD Newsletter, pp. 3-5.
43.
Sogunro, O. A.
(1997). Impact of training on leadership development. Evaluation Review, 21, 731-737.
44.
Spoth, J.
(1992). The impact of executive ideology on structural change. In K. E. Clark, M. B. Clark, & D. P. Campbell (Eds.), Impact of leadership (pp. 281-292). Greensboro, NC: Center for Creative Leadership.
45.
Syvantek, D. J.
, & DeShon, R. P. (1992). Leaders and organizational outcomes in established industries: An analysis of Lee Iacocca and the American automobile industry. In K. E. Clark, M. B. Clark, & D. P. Campbell (Eds.), Impact of leadership (pp. 293-304). Greensboro, NC: Center for Creative Leadership.
46.
Swanson, R. A.
, & Holton, E. F. (1999). Results: How to assess performance, learning, and perceptions in organizations. San Francisco: Berrett-Koehler.
47.
Uhl-Bien, M.
, & Graen, G. B. (1992). An empirical test of the leadership-making model in professional project teams. In K. E. Clark, M. B. Clark, & D. P. Campbell (Eds.), Impact of leadership (pp. 379-388). Greensboro, NC: Center for Creative Leadership.
48.
Watad, M.
, & Ospina, S. (1999). Integrated managerial training: A program for strategic management development. Public Personnel Management, 28, 185-196.
49.
Westcott, R.
(1994). In action: Measuring return on investment (Vol. 1). Alexandria, VA: American Society for Training and Development.
50.
Williams, W. L.
, Greene, J. R., & Bergman, W. T. (1992). Strategic leadership in a big-city police department: The Philadelphia story. In K. E. Clark, M. B. Clark, & D. P. Campbell (Eds.), Impact of leadership (pp. 107-118). Greensboro, NC: Center for Creative Leadership.
51.
Wilson, L. S.
, Boudreaux, M. A., & Edwards, M. (2000). High-performance leadership at the individual level. In E. F. Holton & S. S. Naquin (Eds.), Developing high-performance leadership competency. San Francisco: Berret-Koehler.
