Testing the Equality of Two Independent αCoefficients Adjusted by the Spearman-Brown Formula

Abstract

An approximate statistical test is developed for the hypothesis of equality between the Spearman-Brown extrapolations of two independent values of Cronbach’s alpha reliability coefficient (α). This test assumes that the units added to or deleted from each instrument are classically parallel to the units included in the original version of each instrument. The projections for Tests 1 and 2 are based on lengthening or shortening factors of K ₁ and K ₂, which may or may not be equal. Special cases of this test include applications in which the projected values are intraclass coefficients or only one of the instruments is presumed to be altered in length. Monte carlo simulations demonstrated that the procedure effectively controls Type I error even when the original αs are based on as few as two test parts or two raters.

Get full access to this article

View all access options for this article.

References

Alsawalmeh, Y. M. , & Feldt, L. S. (1992). Test of the hypothesis that the intraclass reliability coefficient is the same for two measurement procedures. Applied Psychological Measurement, 16, 195–205.

Feldt, L. S. (1965). The approximate sampling distribution of Kuder-Richardson reliability coefficient twenty. Psychometrika, 30, 357–370.

Feldt, L. S. (1969). A test of the hypothesis that Cronbach’s alpha orKuder-Richardson coefficient twenty is the same for two tests. Psychometrika, 34, 363–373.

Feldt, L. S. , & Brennan, R. L. (1989). Reliability. In R. L. Linn (Ed.), Educational Measurement(pp.105–146). New York: Macmillan.

Hogg, R. V. , & Craig, A. T. (1978). Introduction to mathematical statistics(4th ed.). New York: Macmillan.

Kendall, M. G. , & Stuart, A. (1977). The advanced theory of statistics(Vol. 1, 4th ed.). New York: Macmillan.

Kristof, W. (1963). The statistical theory of steppedup reliability coefficients when a test has been divided into several equivalent parts. Psychometrika, 28, 221–238.

Novick, M. R. , & Lewis, C. (1967). Coefficient alpha and the reliability of composite measurements. Psychometrika, 32, 1–13.

Odell, P. L. , & Feiveson, A. N. (1966). A numerical procedure to generate a sample covariance matrix. Journal of the American Statistical Association, 61, 199–203.

10.

SAS Institute (1990). SAS/STAT (Version 6.0)[Computer program]. Cary NC: Author.

11.

Satterthwaite, F. E. (1941). Synthesis of variance. Psychometrika, 6, 309–316.

12.

Satterthwaite, F. E. (1946). An approximate distribution of estimates of variance components. Biometrics Bulletin, 2, 110–114.

13.

Scheffé, H. (1959). The analysis of variance.New York: Wiley.