Sage Journals: Discover world-class research

Abstract

A new asymptotic formula for estimating the sampling variance of a correlation coefficient corrected for unreliability and range restriction was proposed. A Monte Carlo assessment of the new sampling variance formula has resulted in the following conclusions. First, the formula-based (analytical) sampling variances were very close to the empirically derived sampling variances based on 5,000 replications. Second, the sampling variance formula was quite robust against committing Type I errors. Third, the statistical power was low to moderate in distinguishing between two unattenuated and unrestricted population correlations. Fourth, the new formula produced smaller sampling variances; was closer to nominal alpha levels; and was more powerful when sample size increased, when the population correlation coefficient increased, when range restriction was less severe, and when both the criterion and predictor reliabilities increased.

Keywords

corrected correlations range restriction reliability standard errors

Get full access to this article

View all access options for this article.

References

Allen, N.L. , & Dunbar, S.B. (1990). Standard errors of correlations adjusted for incidental selection. Applied Psychological Measurement, 14, 83-94.

Bobko, P. (1983). An analysis of correlations corrected for attenuation and range restriction. Journal of Applied Psychology, 68, 584-589.

Bobko, P. , & Rieck, A. (1980). Large sample estimators for standard errors of functions of correlation coefficients. Applied Psychological Measurement, 4, 385-398.

Brandt, D. , McLaughlin, D. , Wise, L. , & Rossmeiss, L.P. (1984). Complex cross-validation of the validity of a predictor battery. Paper presented at the meeting of the American Psychological Association, Toronto.

Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Earlbaum.

Forsyth, R.A. (1971). An empirical note on correlation coefficients corrected for restriction in range. Educational and Psychological Measurement, 31, 115-123.

Forsyth, R.A. , & Feldt, L.S. (1969). An investigation of empirical sampling distributions of correlation coefficients corrected for attenuation. Educational and Psychological Measurement, 29, 61-71.

Gullickson, A. , & Hopkins, K. (1976). Interval estimation of correlation coefficients corrected for restriction of range. Educational and Psychological Measurement, 36, 9-25.

Gulliksen, H. (1950). Theory of mental tests. New York: John Wiley.

10.

Hakstian, A.R. , Schroeder, M.L. , & Rogers, W.T. (1988). Inferential procedures for correlation coefficients corrected for attenuation. Psychometrika, 53, 27-43.

11.

Hakstian, A.R. , Schroeder, M.L. , & Rogers, W.T. (1989). Inferential theory for partially disattenuated correlation coefficients. Psychometrika, 54, 397-407.

12.

Hedges, L.V. (1988). The meta-analysis of test validity studies: Some new approaches. In H. Wainer & H.I. Braun (Eds.), Test validity (pp. 191-212). Hillsdale, NJ: Lawrence Erlbaum.

13.

Hunter, J.E. , & Schmidt, F.L. (1990). Methods of meta-analysis. Beverly Hills, CA: Sage.

14.

Kelley, T.L. (1947). Fundamentals of statistics. Cambridge, MA: Harvard University Press.

15.

Kendall, M. , & Stuart, A. (1977). The advanced theory of statistics (4th ed., Vol. 1). NewYork: Macmillan.

16.

Lord, F.M. , & Novick, M.R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.

17.

Mendoza, J.L. (1993). Fisher transformations for correlations corrected for selection and missing data. Psychometrika, 58, 601-615.

18.

Mendoza, J.L. , & Reinhardt, R.N. (1991). Validity generalization procedures using sample-based estimates: A comparison of six procedures. Psychological Bulletin, 110, 596-610.

19.

Mendoza, J.L. , Stafford, K.L. , & Stauffer, J.M. (2000). Large-sample confidence intervals for validity and reliability coefficients. Psychological Methods, 5, 356-369.

20.

Press, W.H. , Flannery, B.P. , Peukolsky, S.A. , & Vetterling, W.T. (1986). Numerical recipes. New York: Cambridge University Press.

21.

Raju, N.S., Burke, M.J., & Normand, J. (1983). The asymptotic sampling distribution of correlations corrected for attenuation and range restriction. Unpublished manuscript, Illinois Institute of Technology.

22.

Raju, N.S. , Burke, M.J. , Normand, J. , & Langlois, G.M. (1991). A new meta-analytic approach. Journal of Applied Psychology, 76, 432-446.

23.

Rogers, W.T. (1976). Jackknifing disattenuated correlations. Psychometrika, 41, 121-134.

24.

Spearman, C. (1904). The proof and measurement of association between two things. American Journal of Psychology, 15, 72-101.

25.

Stauffer, J.M. , & Mendoza, J.L. (2001). The proper sequence for correcting correlation coefficients for range restriction and unreliability. Psychometrika, 66, 63-68.

Determining the Significance of Correlations Corrected for Unreliability and Range Restriction

Abstract

Keywords

Get full access to this article

References