Although the algorithm for generating a best-subsets variable-selection routine in logistic regression was presented more than a decade ago, a search of the literature reveals that the technique is seldom applied. A possible explanation is its omission from popular statistical computing packages. Newer versions of the Statistical Analysis System (SAS) provide limited capabilities, and the Statistical Package for the Social Sciences (SPSS) does not allow for its calculation. Using a sample data set, this article briefly describes in nonmathematical terms how to implement and interpret results from a best-subsets logistic regression using SAS.
Get full access to this article
View all access options for this article.
References
1.
Cizek, G. J., & Fitzgerald, S. M. (1999). An introduction to logistic regression. Measurement and Evaluation in Counseling and Development, 31(4), 223-244.
2.
Darlington, R. B. (1990). Regression and linear models. New York: McGraw-Hill.
3.
Davis, L. J., & Offord, K. P. (1997). Logistic regression. Journal of Personality Assessment, 68, 497-507.
4.
DeMaris, A. (1995). A tutorial in logistic regression. Journal of Marriage and the Family, 57, 956-968.
5.
Furnival, G. M., & Wilson, R. W. (1974). Regressions by leaps and bounds. Technometrics, 16, 499-512.
6.
Hosmer, D. W., Jovanovic, B., & Lemeshow, S. (1989). Best subsets logistic regression. Biometrics, 45, 1265-1270.
7.
Hosmer, D. W., & Lemeshow, S. (1989). Applied logistic regression. New York: Wiley and Sons.
8.
Hosmer, D. W., & Lemeshow, S. (2000). Applied logistic regression (2nd ed.). New York: Wiley and Sons.
9.
Huberty, C. J. (1989). Problems with stepwise methods—Better alternatives. Advances in Social Science Methodology, 1, 43-70.
10.
Huberty, C. J. (1994). Applied discriminant analysis. New York: Wiley and Sons.
11.
King, J. E. (2002, April). Logistic regression: Beyond point-and-click. Paper presented at the annual meeting of the American Educational Research Association, New Orleans, LA.
12.
Knapp, T., & Sawilowsky, S. (2001). Constructive criticisms of methodological and editorial practices. Journal of Experimental Education, 69, 65-79.
13.
LeBlanc, M., & Fitzgerald, S. (2000). Logistic regression for school psychologists. School Psychology Quarterly, 15, 344-358.
14.
Lemeshow, S., & Hosmer, D. W. (1982). A review of goodness of fit statistics for use in the development of logistic regression models. American Journal of Epidemiology, 115, 92-106.
15.
Lottes, I. L., Adler, M. A., & DeMaris, A. (1996). Using and interpreting logistic regression: A guide for teachers and students. Teaching Sociology, 24, 284-298.
16.
Mallows, C. L. (1973). Some comments on Cp. Technometrics, 15, 661-675.
17.
McNutt, L. A., Holcomb, J. P., & Carlson, B. E. (2000). Logistic regression analysis: When the odds ratio does not work: An example using intimate partner data. Journal of Interpersonal Violence, 15, 1050-1059.
18.
Menard, S. (1995). Applied logistic regression analysis (Sage University Paper Series on Quantitative Applications in the Social Sciences, Series No. 07-106). Thousand Oaks, CA: Sage.
19.
Morgan, S. P., & Teachman, J. D. (1988). Logistic regression: Description, examples, and comparisons. Journal of Marriage and the Family, 50, 929-936.
20.
Morrow-Howell, N., & Proctor, E. K. (1992). The use of logistic regression in social work research. Journal of Social Service Research, 16(1-2), 87-104.
21.
Neter, J., Kutner, M. H., Nachtsheim, C. J., & Wasserman, W. (1996). Applied linear regression models (3rd ed.). Chicago: Irwin.
22.
Pedhazur, E. J. (1997). Multiple regression in behavioral research: Explanation and prediction (3rd ed.). Fort Worth, TX: Harcourt Brace College.
23.
Peng, C. Y.J., Manz, B. D., & Keck, J. (2001). Modeling categorical predictor variables by logistic regression. American Journal of Health Behavior, 25, 278-284.
24.
Rice, J. C. (1994). Logistic regression: An introduction. In B. Thompson (Ed.), Advances in social science methodology (Vol. 3, pp. 3-28). Greenwich, CT: JAI Press.
25.
SAS Institute. (1999). SAS/STAT user's guide, version 8. Cary, NC: Author.
26.
Thompson, B. (1989). Editorial: Why won't stepwise methods die? Measurement and Evaluation in Counseling and Development, 21, 146-148.
27.
Thompson, B. (1995). Stepwise regression and stepwise discriminant analysis need not apply here: A guidelines editorial. Educational and Psychological Measurement, 55, 525-534.
28.
Thompson, B. (2001). Significance, effect sizes, stepwise methods, and other issues: Strong arguments move the field. Journal of Experimental Education, 70, 80-93.
