The problem and the solution. Though much has been written on the topic of career development, the human resource development field has paid little attention to the ways in which career development programs are evaluated.The lack of sound evidence for the effectiveness of career development interventions may be because of the overreliance on Kirkpatrick's ubiquitous evaluation approach or that traditional research methods such as experimental and quasi-experimental designs are not appropriate or feasible in many organizational settings. In this article, we describe the growing profession and practice of evaluation and discuss how the positive psychology movement provides new insights into how career development programs may be evaluated.
Alkin, M. C. (Ed.). (2004). Evaluation roots: Tracing theorists' views and influences. Thousand Oaks, CA: Sage.
2.
Alkin, M. C., & Christie, C. A. (Eds.). (2005). Theorists' models in action. New Directions for Evaluation, 106. San Francisco: Jossey-Bass.
3.
Allee, V. (1997). The knowledge evolution. Boston : Butterworth-Heinemann.
4.
Aspinwall, L.G., & Staudinger U.M. (2003). A psychology of human strengths: Fundamental questions and future directions for a positive psychology. Washington, DC: American Psychological Association .
5.
Bartlett, K.R., Kowske, B.J., & Anthony, K. (2003). Human resource development on the Web: An examination of references to HRD on Fortune 500 Websites. In S. A. Lynham & T. M. Egan (Eds.), Academy of human resource development conference proceedings (pp. 34-41). Bowling Green, OH: Academy of Human Resource Development .
6.
Boudreaux, M.A. (2001). Career development: What is its role in human resource development? In O. Aliaga (Ed.), Academy of human resource development conference proceedings (pp. 805-812). Baton Rouge, LA: Academy of Human Resource Development .
7.
Brinkerhoff, R.O. (2003). The success case method. San Francisco: Berrett-Koehler.
8.
Cameron, K., Dutton, J. E., & Quinn, R. E. (Eds.). (2003). Positive organizational scholarship: Foundations of a new discipline. San Francisco: Berrett-Koehler.
9.
Carr, A. (2004). Positive psychology: The science of happiness and human strengths. New York: Brunner-Routledge.
10.
Cascio, W.F. (2000). The changing world of work: Preparing yourself for the road ahead. In J. M. Kummerow (Ed.), New directions in career planning and the workplace (pp. 3-31). Palo Alto, CA: Davies-Black.
11.
Chapman, L.S. (2004). Expert opinions on “best practices” in worksite health promotion. American Journal of Health Promotion, 18(6), 1-6.
12.
Chermack, T.J., Lynham, S.A., & Ruona, W.E.A. (2003). Critical uncertainties confronting human resource development. Advances in DevelopingHuman Resources, 5, 257-271.
13.
Christie, C.A. (2003). The practice—theory relationship in evaluation. New directions for program evaluation, 97. San Francisco: Jossey-Bass .
14.
Compton, W.C. (2005). An introduction to positive psychology. Belmont, CA: Wadsworth.
15.
Conlon, T.J. (2003). Development of an operational definition of career development for the 21st century workplace. In S. A. Lynham & T. M. Egan (Eds.), Academy of human resource development conference proceedings (pp. 489-493). Bowling Green, OH: Academy of Human Resource Development .
16.
Cooperrider, D. (1990). Positive image; positive action: The affirmative basis of organization. In S. Srivastva & D. L. Cooperrider (Eds.), Appreciative management and leadership (pp. 91-125). San Francisco : Jossey-Bass.
17.
Cooperrider, D. L., & Avital, M. (Eds.). (2004). Constructive discourse and human organization: Advances in appreciative inquiry (Vol. 1). Oxford, UK: Elsevier Science.
18.
Cooperrider, D.L., Whitney, D., & Stavros, J.M. (2003). Appreciative inquiry handbook. Bedford Heights, OH: Lakeshore.
19.
Csikszentmihalyi, M., & Csikszentmihalyi, I.S. (2006). A life worth living: Contributions to positive psychology. New York: Oxford University Press.
20.
Cummings, T.G., & Worley, C.G. (2005). Organization development and change (8th ed.). Mason, OH: South-Western College.
21.
Dagley, J.C., & Salter, S.K. (2004). Practice and research in career counseling and development—2003. Career Development Quarterly, 53, 98-157.
22.
Donaldson, S.I. (2001). Overcoming our negative reputation: Evaluation becomes known as a helping profession. American Journal of Evaluation, 22, 355-361.
23.
Donaldson, S.I. (2004). Using professional evaluation to improve the effectiveness of nonprofit organizations. In R. E. Riggio & S. Smith Orr (Eds.), Improving leadership in nonprofit organizations (pp. 234-251). San Francisco: Jossey-Bass.
24.
Donaldson, S.I. (2007). Program theory-driven evaluation science: Strategies and applications. Mahwah, NJ: Lawrence Erlbaum.
25.
Donaldson, S.I., & Bligh, M. (2006). Rewarding careers applying positive psychological science to improve quality of work life and organizational effectiveness. In S. I. Donaldson, D. E. Berger, & K. Pezdek (Eds.), Applied psychology: New frontiers and rewarding careers (pp. 277-298). Mahwah, NJ: Lawrence Erlbaum.
26.
Donaldson, S.I., & Christie, C.A. (2006). Emerging career opportunities in the transdiscipline of evaluation science. In S. I. Donaldson, D. E. Berger, & K. Pezdek (Eds.), Applied psychology: New frontiers and rewarding careers (pp. 243-260). Mahwah, NJ: Lawrence Erlbaum.
27.
Donaldson, S. I., Christie, C. A., & Mark, M. (in press, Eds.). What counts as credible evidence in applied research and contemporary evaluation practice. Newbury Park, CA : Sage.
28.
Donaldson, S.I., Gooler, L.E., & Scriven, M. (2002). Strategies for managing evaluation anxiety: Toward a psychology of program evaluation. American Journal of Evaluation , 23, 261-273.
29.
Donaldson, S.I., & Lipsey, M.W. (2006). Roles for theory in contemporary evaluation practice: Developing practical knowledge. In I. Shaw, J. Greene, & M. Mark (Eds.), Sage handbook of evaluation (pp. 56-75). London: Sage.
30.
Donaldson, S.I., & Scriven, M. (2003) Evaluating social programs and problems: Visions for the new millennium. Mahwah, NJ: Lawrence Erlbaum.
31.
Drucker, P. (1999). Management challenges for the twenty-first century . New York: Harper Business.
32.
Egan, T.M., Upton, M.G., & Lynham, S.A. (2006). Career development: Load-Baring wall or window dressing? Exploring definitions, theories, and prospects for HRDrelated theory building. Human Resource Development Review, 5, 442-477.
33.
Fitzpatrick, J.L. (2004). Exemplars as case studies: Reflections on the links between theory, practice, and context. American Journal of Evaluation, 25, 541-559.
34.
Fitzpatrick, J.L., Sanders, J.R., & Worthen, B.R. (2003). Program evaluation: Alternative approaches and practical guidelines (3rd ed.). New York: Allyn & Bacon.
35.
Friedman, H.S. (2006). Applying psychology to promote health. In S. I. Donaldson, D. E. Berger, & K. Pezdek (Eds.), Applied psychology: New frontiers and rewarding careers (pp. 201-220). Mahwah, NJ: Lawrence Erlbaum.
36.
Geringer, M.J., Frayne, C.A., & Milliman, J.F. (2002). In search of “best practices” in international human resource management: Research design and methodology. Human Resource Management , 41, 5-30.
37.
Gilley, J.W., Eggland, S.A., & Gilley, A.M. (2002). Principles of human resource development. Boston: Perseus.
38.
Guindon, M.H., & Richmond, L.J. (2005). Practice and research in career counseling and development—2004. Career Development Quarterly, 54, 90-137.
39.
Harris, S. (2005). Best practices of award-winning elementary school principals. Thousand Oaks, CA: Corwin Press.
40.
Harris, D.M., & DeSimone, R.L. (1994). Human resource development . Fort Worth, TX: Dryden Press.
41.
Hawkins, D.J., Van Horn, L.M., & Arthur, M.W. (2004). Community variation in risk and protective factors and substance use outcomes. Prevention Science, 5, 213-220.
42.
Henry, G.T., & Mark, M.M. (2003, Spring). Toward an agenda for research on evaluation . New Directions for Evaluation, 97, 69-80.
43.
Herr, E.L. (2001). Career development and its practice: A historical perspective. Career Development Quarterly, 49, 196-211.
44.
Joint Committee on Standards for Education Evaluation. (1994). The program evaluation standards: How to assess evaluations of educational programs. Thousand Oaks, CA : Sage.
45.
Kauffman, C., & Scoular, A. (2004). Toward a positive psychology of executive coaching . In P. A. Linley & S. Joseph (Eds.), Positive psychology in practice (pp. 287-302). New York: Wiley.
46.
Kirkpatrick, D.L. (1994). Evaluating training programs: The four levels . San Francisco: Berrett-Koehler .
47.
Lerner, R.M. (2003). Developmental assets and asset-building communities: A view of the issues. In R. M. Lerner & P. L. Benson (Eds.), Developmental assets and asset-building communities: Implications for research, policy, and practice (pp. 3-18). New York: Kluwer Academic/Plenum.
48.
Lipsey, M.W., & Wilson, D.B. (1993). The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis. American Psychologist, 48, 1181-1209.
49.
Lopez, S. J., & Snyder, C. R. (Eds.). (2003). Positive psychological assessment: A handbook of models and measures. Washington, DC: American Psychological Association.
50.
Luhans, F. (2002). The need for and meaning of positive organizational behavior. Journal of Organizational Behavior, 23, 695-706.
51.
McDonald, K.S., & Hite, L.M. (2005). Reviving the relevance of career development in human resource development. Human Resource Development Review , 4, 418-439.
52.
McDonald, K.S., Hite, L.M., & Mansour-Cole, D. (2006). Capturing career reflections: Construction of an instrument to explore careers and career development. In F. Nafukho (Ed.), Academy of human resource development conference proceedings. Bowling Green, OH: Academy of Human Resource Development.
53.
McLagan, P.A. (1989). Models for HRD practice. Training and Development Journal, 41, 54-55.
54.
Nakamura, J., & Csikszentmihalyi, M. (2003). The motivational sources of creativity as viewed from a paradigm of positive psychology. In L. G. Aspinwall & U. M. Staudinger (Eds.), A psychology of human strengths: Fundamental questions and future directions for a positive psychology (pp. 257-269). Washington, DC: American Psychological Association .
55.
Patton, M.Q. (1997). Utilization-focused evaluation: The new century text (3rd ed.). Thousand Oaks, CA: Sage.
56.
Preskill, H., & Catsambas, T. (2006). Reframing evaluation through appreciative inquiry . Thousand Oaks, CA: Sage.
57.
Preskill, H., & Coghlan, A. T. (2003). (Eds.). Using Appreciative Inquiry in evaluation. New directions for evaluation, 100. San Francisco: Jossey-Bass.
58.
Preskill, H., & Torres, R.T. (1999). Evaluative inquiry for learning in organizations . Thousand Oaks, CA: Sage.
59.
Ruona, W.E.A., Lynham, S.A., & Chermack, T.J. (2003). Insights on emerging trends and the future of human resource development. Advances in DevelopingHuman Resources, 5, 272-282.
60.
Russ-Eft, D., & Preskill, H. (2001). Evaluation in organizations: A systematic approach for enhancing learning, performance and change. Boston : Perseus Books.
61.
Russon, C. (2004). A decade of international trends in evaluation. EvaluationExchange, IX(4), 12, 19.
62.
Saveri, A., & Falcon, R. (2000). Planning for the 21st century workforce: Key trends that will shape the employment and career landscape. In J. M. Kummerow (Ed.), New directions in career planning and the workplace (pp. 33-76). Palo Alto, CA: Davies-Black.
63.
Scriven, M. (1991). Evaluation thesaurus (4th ed.). Newbury Park, CA: Sage .
64.
Scriven, M. (2003). Evaluation in the new millennium: The transdisciplinary vision. In S. I. Donaldson & M. Scriven (Eds.), Evaluating social programs and problems: Visions for the new millennium (pp. 19-42). Mahwah, NJ: Lawrence Erlbaum.
65.
Seligman, M. (2003). Authentic happiness: Using the new positive psychology to realize your potential for lasting fulfillment. New York: Free Press.
66.
Seligman, M., & Csikszentmihalyi, M. (2000). Positive psychology: An introduction. American Psychologist, 55, 5-14.
67.
Senge, P.M. (1990). The fifth discipline. New York : Doubleday.
68.
Shulha, L.M., & Cousins, J.B. (1997). Evaluation use: Theory, research, and practice since 1986. Evaluation Practice, 18, 195-208.
69.
Simonsen, P. (1997). Promoting a development culture in your organization . Palo Alto, CA: Davies-Black.
70.
Smart, D.H., & Mann, M. (2003). Incorporating appreciative inquiry methods to evaluate a youth development program. In H. Preskill & A. Coghlan (Eds.), New directions for evaluation, 100 (pp. 63-74). San Francisco: Jossey-Bass.
71.
Stevahn, L., King, J.A., Ghere, G., & Minnema, J. (2005). Establishing essential competencies for program evaluators, American Journal of Evaluation, 26, 49-59.
72.
Stewart, T.A. (1997). Intellectual capital. New York : Doubleday/Currency.
73.
Swanson, R.A., & Holton, E.F., III. (2001). Foundations of human resource development. San Francisco: Berrett-Koehler .
74.
Thatchenkery, T., & Metzker, C. (2006). Appreciative intelligence. San Francisco: Berrett-Koehler.
75.
Upton, M.G., Egan, T.M., & Lynham, S.A. (2003). Career development: Definitions, theories, and dependent variables. In S. A. Lynham & T. M. Egan (Eds.), Academy of human resource development conference proceedings (pp. 728-735). Bowling Green, OH: Academy of Human Resource Development .
76.
van Dijk, M.S. (2004). Career development within HRD: Foundation or fad? In T. M. Egan, M. L. Morris, & V. Inbakumar (Eds.), Academy of human resource development conference proceedings (pp. 771-778). Bowling Green, OH: Academy of Human Resource Development .
77.
Webb, L., Preskill, H. , & Coghlan, A. (Eds.). (2005, February). Bridging two disciplines: Applying appreciative inquiry to evaluation practice. AIPractitioner, 1-4.
78.
Werner, E.E. (2000). Protective factors and individual resilience. In J. P. Shonkoff & S. J. Meisels (Eds.), Handbook of early childhood intervention (pp. 115-132). New York: Cambridge University Press.
79.
Wheatley, M.J. (1992). Leadership and the new science. San Francisco: Berrett-Koehler.
80.
Whitney, D., & Trosten-Bloom, A. (2003). The power of appreciative inquiry: A practical guide to positive change. San Francisco : Berrett-Koehler.
81.
Wilkes, R.C., & Bartley, S.J. (2005). Career development program: Survival tool for healthcare industry. In M. L. Morris & F. M. Nafukho (Eds.), Academy of human resource development conference proceedings (pp. 550-557). Bowling Green, OH: Academy of Human Resource Development .
82.
Young, R.A., & Valach, L. (1994). Evaluation of career development programs from an action perspective. CanadianJournal of Counselling, 28, 299-307.
