Techniques such as dominance analysis and relative weight analysis have been proposed recently to evaluate more accurately predictor importance in ordinary least squares (OLS) regression. Similar questions of predictor importance also arise in instances where logistic regression is the primary mode of analysis. This article presents an extension of relative weight analysis that can be applied in logistic regression and thus aids in the determination of predictor importance. We briefly review relative importance techniques and then discuss a new procedure for calculating relative importance estimates in logistic regression. Finally, we present a substantive example applying this new approach to an example data set.
Aguinis, H., Werner, S., Abbott, J.L., Angert, C., Park, J.H., & Kohlhausen, D. (2010). Customer-centric science: Reporting significant research results with rigor, relevance, and practical impact in mind. Organizational Research Methods, 13, 515-539.
2.
Azen, R., & Budescu, D.V. ( 2003). Comparing predictors in multivariate regression models: An extension of dominance analysis. Journal of Educational and Behavioral Statistics, 31, 157-180.
3.
Baltes, B.B., Parker, C.P., Young, L.M., Huff, J., & Altmann, R. ( 2004). The practical utility of importance measures in assessing the relative importance of work related perceptions and organizational characteristics on work related outcomes. Organizational Research Methods , 7, 326-340.
4.
Bartone, P., Roland, R., Picano, J., & Williams, T. ( 2008). Psychological hardiness predicts success in U.S. Army Special Forces candidates. International Journal of Selection and Assessment, 16, 78-81.
5.
Budescu, D.V. ( 1993). Dominance analysis: A new approach to the problem of relative importance of predictors in multiple regression. Psychological Bulletin, 114, 542-551.
6.
Budescu, D.V., & Azen, R. ( 2004). Beyond global measures of relative importance: Some insights from dominance analysis. Organizational Research Methods, 7, 341-350.
7.
Cortina, J.M., & Landis, R.S. ( 2009). When small effect sizes tell a big story, and when large effect sizes don’t. In C. E. Lance & R. J. Vandenberg (Eds.), Statistical and methodological myths and urban legends: Doctrine, verity and fable in the organizational and social sciences (pp. 287-308). New York: Routledge.
8.
Cox, D.R., & Snell, E.J. ( 1989). The analysis of binary data (2nd ed.). London: Chapman and Hall .
9.
Darlington, R.B. ( 1968). Multiple regression in psychological research and practice . Psychological Bulletin, 69, 161-182.
10.
Estrella, A. ( 1998). A new measure of fit for equations with dichotomous dependent variables. Journal of Business and Economic Statistics, 16, 198-205.
11.
Frone, M. ( 2000). Work-family conflict and employee psychiatric disorders: The national comorbidity survey. Journal of Applied Psychology , 85, 888-895.
12.
Glomb, T.M., Kammeyer-Mueller, J.D., & Rotundo, M. ( 2004). Emotional labor demands and compensating wage differentials . Journal of Applied Psychology, 84, 700-714.
13.
Goldman, B. ( 2001). Toward an understanding of employment discrimination claiming: An integration of organizational justice and social information processing. Personnel Psychology, 54, 361-387.
14.
Jackson, C.L., Colquitt, J.A., Wesson, M.J., & Zapata-Phelan, C.P. (2006). Psychological collectivism: A measurement validation and linkage to group member performance. Journal of Applied Psychology, 91, 884-899.
15.
Johnson, J.W. ( 2000). A heuristic method for estimating the relative weight of predictor variables in multiple regression. Multivariate Behavioral Research, 35, 1-19.
16.
Johnson, J.W. ( 2001). Determining the relative importance of predictors in multiple regression: Practical applications of relative weights. In F. Columbus (Ed.), Advances in psychology research (Vol. 5, pp. 231-251). Huntington, NY: Nova Science.
17.
Johnson, J.W. ( 2004). Factors affecting relative weights: The influence of sampling and measurement error. Organizational Research Methods , 7, 283-299.
18.
Johnson, J.W., & LeBreton, J.M. (2004). History and use of relative importance indices in organizational research. Organizational Research Methods, 7, 238-257.
19.
Johnson, R.M. ( 1966). The minimal transformation to orthogonality. Psychometrika, 31, 61-66.
20.
LeBreton, J.M., Ployhart, R.E., & Ladd, R.T. ( 2004). A Monte Carlo comparison of relative importance methodologies . Organizational Research Methods, 7, 258-282.
21.
LeBreton, J.M., & Tonidandel, S. (2008). Multivariate relative importance: Extending relative weight analysis to multivariate criterion spaces. Journal of Applied Psychology, 93, 329-345.
22.
Lievens, F., Highhouse, S., & De Corte, W. ( 2005). The importance of traits and abilities in supervisors’ hirability decisions as a function of method of assessment. Journal of Occupational and Organizational Psychology, 78, 453-470.
23.
Lievens, F., Van Hoye, G., & Schreurs, B. ( 2005). Examining the relationship between employer knowledge dimensions and organizational attractiveness: An application in a military context. Journal of Occupational and Organizational Psychology , 78, 553-572.
24.
Lyness, K., & Judiesch, M. ( 1999). Are women more likely to be hired or promoted into management positions? Journal of Vocational Behavior, 54, 158-173.
25.
Maddala, G.S. ( 1983). Limited-dependent and qualitative variables in econometrics. UKCambridge University Press.
26.
Martell, R.F., Lane, D.M., & Emrich, C. ( 1996). Male-female differences: A computer simulation. American Psychologist, 51, 157-158.
27.
McFadden, D. ( 1974). The measurement of urban travel demand. Journal of Public Economics, 3, 303-328.
28.
Meade, A.W., Behrend, T.S., & Lance, C.E. ( 2008). Dr. StrangeLOVE, or: How I learned to stop worrying and love omitted variables. In C. E. Lance & R. J. Vandenberg (Eds.), Statistical and methodological myths and urban legends: Doctrine, verity and fable in the organizational and social sciences (pp. 91-108). New York: Routledge.
29.
Menard, S. ( 2000). Coefficients of determination for multiple logistic regression analysis. The American Statistician, 54, 17-24.
30.
Menard, S. ( 2004). Six approaches to calculating standardized logistic regression coefficients. The American Statistician, 58, 218-223.
31.
Nagelkerke, N.J.D. ( 1991). A note on a general definition of the coefficient of determination. Biometrika, 78, 691-692.
32.
Pollina, D., Dollins, A., Senter, S., Krapohl, D., & Ryan, A. ( 2004). Comparison of polygraph data obtained from individuals involved in mock crimes and actual criminal investigations. Journal of Applied Psychology, 89, 1099-1105.
33.
Posthuma, R., Maertz, C., & Dworkin, J. ( 2007). Procedural justice’s relationship with turnover: Explaining past inconsistent findings. Journal of Organizational Behavior, 28, 381-398.
34.
Schleicher, D.J., Venkataramani, V., Morgeson, F.P., & Campion, M.A. ( 2006). So you didn’t get the job . . . now what do you think? Examining opportunity-to-perform fairness perceptions. Personnel Psychology, 59, 559-590.
35.
Sprigg, C., Stride, C., Wall, T., Holman, D., & Smith, P. ( 2007). Work characteristics, musculoskeletal disorders, and the mediating role of psychological strain: A study of call center employees . Journal of Applied Psychology, 92, 1456-1466.
36.
Tonidandel, S., LeBreton, J.M., & Johnson, J.W. ( 2009). Determining the statistical significance of relative weights. Manuscript submitted for publication.
37.
Traxel, N.M., & Azen, R. ( 2006, August). Predictor importance in logistic regression: An extension of dominance analysis. Poster presented at the 114th Annual Convention of the American Psychological Association, New Orleans, LA.
