Sage Journals: Discover world-class research

Abstract

In studies where the response variable is measured on a ratio scale, a ratio of means or medians provides a standardized measure of effect size that is an alternative to the popular standardized mean difference. Confidence intervals for ratios of population means and medians in independent-samples designs and paired-samples designs are proposed as supplements to the independent-samples t test and paired-samples t test. The performance of the proposed confidence intervals are evaluated in a simulation study. The proposed confidence interval methods are extended to the case of a 2 × m factorial design that includes propensity score stratification and meta-analysis as special cases. R functions that implement the recommended confidence intervals are provided in the Supplemental Material file, available in the online version of this article, and are illustrated with several examples.

Keywords

distribution-free skewed data effect size independent-samples designs paired-samples designs factorial designs meta-analysis

Get full access to this article

View all access options for this article.

References

American Psychological Association. (2019). Publication manual of the American Psychological Association (7th ed.). Author.

Beyene

Moineddin

(2005). Methods for confidence interval estimation of a ratio parameter with applications to location quotients. BMC Medical Research Methodology, 5, 32. http://doi.org/10.1186/1471-2288-5-32

Bickel

P. J.

Doksum

K. A.

(1977). Mathematical statistics. Holden-Day.

Bonett

D. G.

(2008). Confidence intervals for standardized linear contrasts of means. Psychological Methods, 13, 99–109. http://doi .org/10.1037/1082-989X.13.2.99

Bonett

D. G.

(2009). Meta-analytic interval estimation for standardized and unstandardized mean differences. Psychological Methods, 14, 225–238. http://doi.org/10.1037/a0016619

Bonett

D. G.

Price

R. M.

(2015). Varying coefficient meta-analysis methods for odds ratios and risk ratios. Psychological Methods, 20, 394–406. http://doi .org/10.1037/met0000032

Bonett

D. G.

Price

R. M.

(2020). Interval estimation for linear functions of medians in within-subject and mixed designs. British Journal of Mathematical and Statistical Psychology, 73, 333–346. http://doi .org/10.1111/bmsp.12171

Borenstein

Hedges

L. V.

Higgins

J. P. T.

Rothstein

H. R.

(2009). Introduction to meta-analysis. Wiley.

Button

K. S.

Kounali

Thomas

Wiles

N. J.

Peters

N. J.

Ades

A. E.

Lewis

(2015). Minimal clinically important difference on the Beck Depression Inventory—II according to patient’s perspective. Psychological Medicine, 45, 3269–3279. http://doi.org/10.1017/S0033291715001270

10.

Casella

Berger

R. L.

(2002). Statistical inference (2nd ed.). Duxbury.

11.

Fieller

E. C.

(1954). Some problems in interval estimation. Journal of the Royal Statistical Society, Series B, 16, 175–185. http://doi .org/10.2307/2984043

12.

Friedrich

J. O.

Adhikari

N. K. J.

Beyene

(2008). The ratio of means method as an alternative to mean differences for analyzing continuous outcome variables in meta-analysis: A simulation study. BMC Medical Research Methodology, 8, 32. https://doi.org/10.1186/1471-2288-8-32

13.

Glass

G. V.

Hopkins

K. D.

(1984). Statistical methods in education (2nd ed.). Prentice Hall.

14.

Hays

W. L.

(1973). Statistics for the social sciences (2nd ed.). Holt, Rinehart and Winston.

15.

Hedges

L. V.

Gurevitch

Curtis

P. S.

(1999). The meta-analysis of response ratios in experimental ecology. Ecology, 80, 1150–1156. http://doi.org/10.1890/0012-9658(1999)080[1150:TMAORR]2.0.CO;2

16.

Hirschberg

Lye

(2010). A geometric comparison of the delta and Fieller confidence intervals. The American Statistician, 64, 234–241. http://doi.org/10.1198/tast.2010.08130

17.

Howell

D. C.

(2007). Statistical methods for psychology (6th ed.). Thompson.

18.

Kline

R. B.

(2013). Beyond significance testing: Statistical reform in the behavioral sciences (2nd ed.). American Psychological Association.

19.

Kline

T. J. B.

(2005). Psychological testing: A practical approach to design and evaluation. Sage.

20.

Lehmann

E. L.

(1999). Elements of large-sample theory. Springer.

21.

Maritz

J. P.

(1991). Estimating the covariance matrix of bivariate medians. Statistics & Probability Letters, 12, 305–309. http://doi.org/10.1016/0167-7152(91)90096-A

22.

MATLAB. (2019). (Version 9.7.0) [R2019b]. The MathWorks.

23.

Micceri

(1989). The unicorn, the normal curve, and other improbable creatures. Psychological Bulletin, 105, 156–166. http://doi .org/10.1037/0033-2909.105.1.156

24.

Mood

A. M.

(1941). On the joint distribution of medians in samples from a multivariate population. Annals of Mathematical Statistics, 12, 268–278. https://www.jstor.org/stable/2235856

25.

Nelson

(1998). An introduction to copulas. Springer.

26.

Newcombe

R. G.

(2013). Confidence intervals for proportions and related measures of effect sizes. CRC Press.

27.

Pustejovsky

J. E.

(2018). Using response ratios for meta-analyzing single-case designs with behavioral outcomes. Journal of School Psychology, 68, 99–112. https://doi.org/10.1016/j.jsp.2018.02.003

28.

Price

R. M.

Bonett

D. G.

(2002). Distribution-free confidence intervals for difference and ratio of medians. Journal of Statistical Computation & Simulation, 72, 119–124. http://doi.org/10.1080/00949650212140

29.

R Core Team. (2019). R: A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org/

30.

Raftery

A. E.

Schweder

(1993). Inferences about the ratio of two parameters, with applications to whale censusing. The American Statistician, 47, 259–264. http://doi.org/10.1080/00031305.1993.10475994

31.

SAS Institute. (2011). SAS/STAT(R) 9.2 user’s guide (2nd ed.). SAS Institute.

32.

StataCorp. (2019). Stata Statistical Software: Release 16. StataCorp LLC.

33.

Stuart

Ord

J. K.

(1994). Kendall’s advanced theory of statistics, Vol. 1: Distribution theory (6th ed.). Edward Arnold.

34.

Wellek

(2010). Testing statistical hypotheses of equivalence and noninferiority (2nd ed.). Chapman & Hall.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.02 MB

1.75 MB

Confidence Intervals for Ratios of Means and Medians

Abstract

Keywords

Get full access to this article

References

Supplementary Material