This paper argues that most utility analysis (UA) applications are flawed because they employ an overly simplistic formula. This piece reviews the literature on UA adjustments and demonstrates that the adjustments have a large impact on resulting estimates. These results imply that human resources programs do not invariably yield positive returns; rather, intervention success is contingent on program-specific, organizational, and environmental factors.
Get full access to this article
View all access options for this article.
References
1.
Ashe, R. L., Jr.1990, April. The legal defensibility of assessment centers and in-basket exercises. Paper presented at the meeting of the Society for Industrial and Organizational Psychology, Miama Beach, FL.
2.
Barrett, G. V., Caldwell, M. S., & Alexander, R. A.1989. The predictive stability of ability requirements for task performance: A critical reanalysis. Human Performance, 2: 167–181.
3.
Becker, B. E.1989. The influence of labor markets on human resource utility estimates. Personnel Psychology, 42: 531–546.
4.
Black, F., & Scholes, M.1973. The pricing of options and corporate liabilities. Journal of Political Economy, 81: 637–654.
5.
Boudreau, J. W.1983a. Economic considerations in estimating the utility of human resource productivity improvements. Personnel Psychology, 36: 551–557.
6.
Boudreau, J. W.1983b. Effects of employee flows on utility analysis of human resource productivity improvement programs. Personnel Psychology, 68: 396–407.
7.
Boudreau, J. W.1991. Utility analysis for decisions in human resource management. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology, Volume 1: 621–745. Palo Alto, CA: Consulting Psychologist Press.
8.
Boudreau, J. W.1996. Motivational impact of utility analysis and HR measurement. Journal of Human Resource Costing and Accounting, 1: 73–84.
9.
Boudreau, J. W., & Berger, C. J.1985. Decision-theoretic utility analysis applied to external employee movement. Journal of Applied Psychology, 70: 581–612.
10.
Brogden, H. E.1949. When testing pays off. Personnel Psychology, 2: 171–183.
11.
Burke, M. J., & Frederick, J. T.1986. A comparison of economic utility estimates for alternative rational SDy estimation procedures. Journal of Applied Psychology, 71: 334–339.
12.
Cascio, W. F.1993. Assessing the utility of selection decisions: Theoretical and practical considerations. In N. Schmitt & W. C. Borman (Eds.), Personnel selection in organizations: 310–340. San Francisco, CA: Jossey-Bass.
13.
Cascio, W. F.1996. The role of utility analysis in the strategic management of organizations. Journal of Human Resource Costing and Accounting, 1: 85–95.
14.
Cascio, W. F.2000. Costing human resources: The financial impact of behavior in organizations (14th ed.). Boston, MA: Kent.
15.
Cronbach, L. J., & Glesser, G. C.1965. Psychological tests and personnel decisions. Urbana: University of Illinois Press.
16.
Cronshaw, S. F.1986. The utility of employment testing for clerical/administrative trades in the Canadian Military. Canadian Journal of Administrative Sciences, 3: 376–385.
17.
Cronshaw, S. F.1997. Lo! The stimulus speaks: The insider’s view on Whyte and Latham’s “The Futility of Utility Analysis.” Personnel Psychology, 50: 611–616.
18.
Darlington, R. B.1968. Multiple regression in psychological research and practice. Psychological Bulletin, 69: 161–182.
19.
De Corte, W.1994. Utility analysis for the one-cohort selection-retention decision with a probationary period. Journal of Applied Psychology, 79: 402–411.
20.
Economist. 1997. The right option: The Nobel Prize for economists. October 18: 75-75.
21.
Florin-Thuma, B. C., & Boudreau, J. W.1987. Performance feedback utility in a small organization: Effects on organizational outcomes and managerial decision processes. Personnel Psychology, 40: 693–713.
22.
Gatewood, R. D., & Feild, H. S.1994. Human resource selection (2nd ed.). Chicago, IL: Dryden Press.
23.
Henry, R. A., & Hulin, C. L.1987. Stability of skilled performance across time: Some generalizations and limitations on utilities. Journal of Applied Psychology, 72: 457–462.
24.
Hogarth, R. M., & Einhorn, H. J.1976. Optimal strategies for personnel selection when candidates can reject job offers. Journal of Business, 49: 479–495.
25.
Hulin, C. L., Henry, R. A., & Noon, S. L.1990. Adding a dimension: Time as a factor in the generalizability of predictive behaviors. Psychological Bulletin, 107: 328–340.
26.
Hunter, J. E., Schmidt, F. L., & Coggin, T. D.1988. Problems and pitfalls in using capital budgeting and financial accounting techniques in assessing the utility of personnel programs. Journal of Applied Psychology, 73: 522–528.
27.
Huselid, M. A.1995. The impact of human resource management practices on turnover, productivity, and corporate financial performance. Academy of Management Journal, 38: 635–672.
28.
Judiesch, M. K., Schmidt, F. L., & Hunter, J. E.1993. Has the problem of judgment in utility analysis been solved?Journal of Applied Psychology, 78: 903–911.
29.
Latham, G. P., & Whyte, G.1994. The futility of utility analysis. Personnel Psychology, 47: 31–46.
30.
Morrow, C. C., Jarrett, M. Q., & Rupinski, M. T. (1997). An investigation of the effect and economic utility of corporate-wide training. Personnel Psychology, 50: 91–119.
31.
Murphy, K. R.1986. When your top choice turns you down: Effect of rejected offers on the utility of selection tests. Psychological Bulletin, 99: 133–138.
32.
Pfeffer, J.1994. Competitive advantage through people: Unleashing the power of the work force. Boston, MA: Harvard Business School Press.
33.
Raju, N. S., & Burke, M. J.1986. Utility analysis. In R. A. Burk (Ed.), Performance assessment: Methods and applications: 186–202. Baltimore, MD: Johns Hopkins.
34.
Raju, N. S., Burke, M. J., & Maurer, T. J.1995. A note on direct range restriction adjustments in utility analysis. Personnel Psychology, 48: 143–149.
35.
Raju, N. S., Burke, M. J., & Normand, J.1990. A new approach for utility analysis. Journal of Applied Psychology, 77: 234–250.
36.
Raju, N. S., Burke, M. J., Normand, J., & Lezotte, D. V.1993. What would be if what is wasn’t? Rejoinder to Judiesch, Schmidt, and Hunter (1993). Journal of Applied Psychology, 78: 912–916.
37.
Schmidt, F. L., Hunter, J. E., McKenzie, R. C., & Muldrow, T. W. (1979). Impact of valid selection procedures on work-force productivity. Journal of Applied Psychology, 64: 609–626.
38.
Terpstra, D. E., & Rozell, E. J.1993. The relationship of staffing practices to organizational level measures of performance. Personnel Psychology, 46: 27–48.
39.
Whyte, G., & Latham, G. P.1997. The futility of utility analysis revisited: When even an expert fails. Personnel Psychology, 50: 601–610.
40.
Williams, C. R., & Livingstone, L. P.1994. Another look at the relationship between performance and voluntary turnover. Academy of Management Journal, 37: 269–298.
41.
Wintermantel, R. E., & Mattimore, K. L.1997. In the changing world of human resources: Matching measures to mission. Human Resource Management, 36: 337–342.
