How Much More Likely? The Implications of Odds Ratios for Probabilities

Abstract

Binary outcome data are common in research and evaluation. They are often analyzed using logistic regression, and results of these analyses are often reported in the form of odds ratios (ORs). However, ORs are not directly interpretable in the metric commonly used in policy-relevant discussions, which concerns probabilities. ORs are unfamiliar to nonresearchers, and their relationship to probability implications is not well understood by researchers. For example, the common practice of taking ORs as direct estimates of changes in probabilities (i.e., as risk ratios) systematically inflates effect sizes in probability terms. Fortunately, the probability implications of ORs can be derived simply and can be presented concretely as contrasting pairs of probabilities. These probability pairs are easily understandable by both the research and the lay audiences for evaluation results. After reviewing the relationship between probabilities, odds, and their ratios, this article shows how to explore ORs’ implications for probabilities, illustrating with recent examples from the literature.

Keywords

odds ratio risk ratio relative risk odds probability

Get full access to this article

View all access options for this article.

References

Agresti, A. (1990). Categorical data analysis. Hoboken, NJ: John Wiley.

Burruss, G. W. , & Kempf-Leonard, K. (2002). The questionable advantage of defense counsel in juvenile court. Justice Quarterly, 19, 37-67.

Cohen, J. (1977). Statistical power analysis for the behavioral sciences, revised edition. London: Academic Press.

Cohen, J. , & Cohen, P. (1983). Applied multiple regression/correlation analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.

DeMaris, A. (1992). Logit modeling (Sage University Paper Series on Quantitative Applications in the Social Sciences, 07-086). Newbury Park, CA: Sage.

Federal Interagency Forum on Child and Family Statistics . (2003). America’s children: Key national indicators of well-being, 2003. Washington, DC: U.S. Government Printing Office.

Fleiss, J. L. (1981). Statistical methods for rates and proportions. New York: John Wiley.

Fleiss, J. L. (1994). Measures of effect size for categorical data. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 245-260). New York: Russell Sage.

Haddock, C. K. , Rindskopf, D. , & Shadish, W. R. (1998). Using odds ratios as effect sizes for meta-analysis of dichotomous data: A primer on methods and issues. Psychological Methods, 3, 339-353.

10.

Hawkins, J. D. , Herrenkohl, T. , Farrington, D. P. , Brewer, D. , Catalano, R. F. , & Harachi, T. W. (1998). A review of predictors of youth violence. In R. Loeber & D. P. Farrington (Eds.), Serious and violent juvenile offenders: Risk factors, and successful interventions (pp. 106-146). Thousand Oaks, CA: Sage.

11.

Henry, G. T. (Ed.). (1997). Creating effective graphs: Solutions for a variety of evaluation data. New Directions for Evaluation, 73.

12.

Hosmer, D. W. , & Lemeshow, S. (1989). Applied logistic regression. New York: John Wiley.

13.

King, G. , Tomz, M. , & Wittenberg, J. (2000). Making the most of statistical analyses: Improving interpretation and presentation. American Journal of Political Science, 44, 341-355.

14.

Lipsey, M. W. , & Wilson, D. B. (2001). Practical meta-analysis. New York: Sage.

15.

Long, S. J. (1997). Regression models for categorical and limited dependent variables. Thousand Oaks, CA: Sage.

16.

Maxwell, C. D. , Garner, J. H. , & Fagan, J. A. (2002). The preventive effects of arrest on intimate partner violence: Research, policy, and practice. Criminology and Public Policy, 2, 51-80.

17.

Menard, S. (1995). Applied logistic regression analysis (Sage University Paper Series on Quantitative Applications in the Social Sciences, 07-106). Thousand Oaks, CA: Sage.

18.

Rosenthal, R. (1990). How are we doing in soft psychology? American Psychologist, 45, 775-777.

19.

Rosenthal, R. , & Rubin, D. B. (1982). A simple, general purpose display of magnitude of experimental effect. Journal of Educational Psychology, 74, 166-169.

20.

Rossi, P. H. (1997). Advances in quantitative evaluation, 1987-1996. New Directions in Evaluation, 76, 57-68.

21.

Tufte, E. R. (1983). The visual display of quantitative information. Cheshire, CT: Graphics Press.

22.

University of Wisconsin Medical School, Department of Pediatrics . (2004). For parents of preemies: Anticipating the birth of a premature infant. Retrieved December 14, 2004, from http://www.pediatrics.wisc.edu/patientcare/preemies/anticipating.html

23.

U.S. Department of Health and Human Services . (2001). Youth violence: A report of the surgeon general. Rockville, MD: Author.

24.

Zhang, J. , & Yu, K. F. (1998). What’s the relative risk? A method of correcting the odds ratio in cohort studies of common outcomes. Journal of the American Medical Association, 280, 1690-1691.