Sage Journals: Discover world-class research

Abstract

Researchers sometimes need a statistical test of the hypothesis that two values of Cronbach's alpha reliability coefficient are equal. The situation may involve scores from two different measures administered to independent random samples or from the same measure administered to random samples from two different populations. Feldt derived a test that functions well with large or moderate numbers of subjects. However, he validated this test only when the number of parts (k) of the measurement was fairly large, as it would be if the parts were individual test items. He did not consider instances in which the parts were raters, and hencek would be as small as 2 or 3. In this article, the Feldt test is investigated for such situations. It is found to function quite well in its control of Type I error.

Keywords

reliability Cronbach's coefficient alpha difference in reliability estimates small samples

Get full access to this article

View all access options for this article.

References

Alsawalmeh, Y. M. , & Feldt, L. S. (1999).Testing the equality of independentalpha coefficients adjusted for test length.Educational and Psychological Measurement,59, 373–383.

Brennan, R. L. (2001).Generalizability theory. New York: Springer.

Cook, D. L. (1959). A replication of Lord's study of skewness and kurtosis of observed test-score distributions.Educational and Psychological Measurement,19, 81–87.

Cronbach, L. J. (1990).Essentials of psychological testing (5th ed.). New York: Harper & Row.

Feldt, L. S. (1965). The approximate sampling distribution of Kuder-Richardson reliability coefficient twenty.Psychometrika,30, 357–370.

Feldt, L. S. (1969). A test of the hypothesis that Cronbach's alpha or Kuder-Richardson coefficient twenty is the same for two tests.Psychometrika,34, 363–373.

Feldt, L. S. , & Ankenmann, R. D. (1998). Appropriate sample size for comparing alpha reliabilities.Applied Psychological Measurement,22, 170–178.

Feldt, L. S. , & Ankenmann, R. D. (1999). Determining sample sizes for a test of equality of alpha coefficients when the number of part-tests is small.Psychological Methods,4, 366–377.

Feldt, L. S. , & Qualls, A. L. (1996). Bias in coefficient alpha arising from heterogeneity of test content. Applied Measurement in Education,9, 277–286.

10.

Jöreskog, K. , & Sörbom, D. (1996).LISREL 8: User's reference guide. Chicago: Scientific Software International.

11.

Kendall, M. , & Stuart, A. (1977).The advancedtheory of statistics (4th ed., Vol. 1). New York: Macmillan.

12.

Lee, G. , Dunbar, S. B. , & Frisbie, D. A. (2001). The relative appropriateness of eight measurement models for analyzing scores from tests composed of testlets.Educational and Psychological Measurement,61, 958–975.

13.

Lord, F. M. (1955).A survey of observed test-score distributions with respect to skewness and kurtosis.Educational and Psychological Measurement,15, 383–389.

14.

Novick, M. R. , & Lewis, C. (1967). Coefficient alpha and the reliability of composite measurements. Psychometrika,32, 1–13.

15.

Odell, P. L. , & Feiveson, A. H. (1966). A numerical procedure to generate a sample covariance matrix.Journal of the American Statistical Association,61, 199-203.

16.

Schumann, D. E. W. , & Bradley, R. A. (1957). The comparison of the sensitivities of similar experiments: Theory.Annals of Mathematical Statistics,28, 902–920.

Testing the Difference Between Two Alpha Coefficients With Small Samples of Subjects and Raters

Abstract

Keywords

Get full access to this article

References