Several methods of constructing confidence intervals (CIs) for Spearman's rho were tested in a Monte Carlo investigation. A total of 2,000 samples of sizes 10, 50, and 200 were randomly drawn from bivariate normal populations with p, equal to .00, .29, .43, .58, .73, and .89. Each method for computing a 95% CI around p3 was evaluated with regard to size in the null case and power and coverage in non-null cases. Fisher's z transformation of r, worked well provided N was not small and Ps was not too large. The CIs constructed using the variance estimate for product-moment correlations had coverages that were consistently too liberal. Kraemer's method for establishing CIs produced coverages that were conservative. An empirical attempt to adjust the Fisher CI maintained Type I error rate near the nominal level in all cases with no loss of power. Arguments are made for the continued use of r, in behavioral research.
Get full access to this article
View all access options for this article.
References
1.
Cliff, N. (1993). Dominance statistics: Ordinal analyses to answer ordinal questions. Psychological Bulletin, 114, 494-509.
2.
Cliff, N. (1996). Ordinal statistics to answer ordinal questions with ordinal data. Orlando, FL: Harcourt Brace.
3.
Cohen, J. (1994). The earth is round (p < .05). American Psychologist, 49, 997-1003.
4.
David, F. N. , & Mallows, C. L. (1961). The variance of Spearman's rho in normal samples. Biometrika, 48, 19-28.
5.
David, S. T. , Kendall, M. G., & Stuart, A. (1951). Some questions of distribution in the theory of rank correlation. Biometrika, 38, 131-140.
6.
Duncan, G. T. , & Layard, M.W.J. (1973). A Monte Carlo study of asymptotically robust test for correlation coefficients. Biometrika, 60, 551-558.
7.
Fieller, E. C. , Hartley, H. O., & Pearson, E. S. (1957). Tests for rank correlation coefficients (part 1). Biometrika, 44, 470-481.
8.
Fieller, E. C. , & Pearson, E. S. (1961). Tests for rank correlation coefficients (part 2). Biometrika, 48, 29-40.
9.
Franklin, L. A. (1988). The complete exact null distribution of Spearman's rho for n = 12 (1) 18. Journal of Statistical Computation and Simulation, 29, 255-269.
10.
Hays, W. L. (1973). Statistics for the social sciences. New York: Holt, Rinehart & Winston.
11.
Kendall, M. G. (1949). Rank and product-moment correlation. Biometrika, 36, 177-193.
12.
Kendall, M. G. , Kendall, F. H., & Smith, B. B. (1938). The distribution of Spearman's coefficient of correlation in a universe in which all rankings occur an equal number of times. Biometrika, 30, 251-273.
13.
Kraemer, H. C. (1975). On estimation and hypothesis testing problems for correlation coefficients. Psychometrika, 40, 473-485.
14.
Long, J. D., & Cliff, N. (1995). Sampling behavior of Pearson 's r and Kendall's tau as a function of normality, sample size, and strength of association. Unpublished manuscript, Department of Psychology, University of Southern California.
15.
Long, J. D. , & Cliff, N. (in press). Confidence intervals for Kendall's tau. British Journal of Mathematical and Statistical Psychology.
16.
Meehl, P. E. (1967). Theory testing in psychology and physics: A methodological paradox. Philosophy of Science, 34, 103-115.
17.
Meehl, P. E. (1990). Why summaries of research on psychological theories are often uninterpretable. Psychological Reports, 66(Monograph Suppl. 1-V66), 195-244.
18.
Micceri, T. (1989). The unicorn, the normal curve, and other improbable creatures. Psychological Bulletin, 105, 156-166.
19.
Ramsey, P. H. (1989). Critical values for Spearman's rank order correlation. Journal of Educational Statistics, 14, 245-253.
20.
Rasmussen, J. L. (1987). Estimating correlation coefficients: Bootstrap and parametric approaches. Psychological Bulletin, 101, 136-139.
21.
Roberts, D. M. , & Kunst, R. E. (1990). A case against the use of the Spearman formula for rank correlation. Psychological Reports, 66, 339-349.
22.
Spearman, C. (1904). The proof and measurement of association between two things. American Journal of Psychology, 14, 72-101.
23.
Spearman, C. (1906). "Footrule" for measuring correlation. British Journal of Psychology, 2, 89-108.
24.
Stevens, S. S. (1951). Mathematics, measurement and psychophysics. In S. S. Stevens (Ed.), Handbook of experimental psychology (pp. 1-49). New York: John Wiley.
25.
Thompson, B. (1989). Statistical significance, result importance, and result generalizability: Three noteworthy but somewhat different issues. Measurement and Evaluation in Counseling and Development, 22, 2-6.
26.
Thompson, B. (1993). The use of statistical significance tests in research: Bootstrap and other alternatives. Journal of Experimental Education, 61, 361-377.
27.
Thornton, G. R. (1943). The significance of rank difference coefficients of correlation. Psychometrika, 8, 211-222.
28.
Tukey, J. W. (1991). The philosophy of multiple comparisons. Statistical Science, 6, 100-116.
