ANOVA computed intraclass reliability coefficients are often underestimated because ANOVA assumptions are ignored. Assumptions of an alternate technique are explored. Biasedness of the intraclass reliability coefficient is discussed and a table of corrections presented.
Get full access to this article
View all access options for this article.
References
1.
Ebel, R. L.Estimation of the reliability of ratings. Psychometrika, 1951, 16, 407-424 .
2.
Finn, R. H.A note on estimating the reliability of categorical data. EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT , 1970, 30, 71-76.
3.
Hogg, R. V. and Craig, A. T.Introduction to mathematical statistics (3rd ed.). New York: Macmillan, 1971.
4.
Hoyt, C.Test reliability estimated by analysis of variance. Psychometrika, 1941, 6, 153-160 .
5.
Olkin, I. and Pratt, J. W.Unbiased estimation of certain correlation coefficients . Annals of Mathematical Statistics , 1958 , 29, 201 -211.
6.
Winer, B. J.Statistical principles in experimental design (2nd ed.). New York: McGraw-Hill, 1971.
