A Simple Computational Alternative to Analysis of Variance Formulas for Estimating the K -Judge Reliability

Abstract

Formulas requiring the computation of only three standard deviations are presented for computing the interjudge reliability coefficient for any number of judges. These formulas yield coefficients identical to those obtained from a one-way repeated-measures analysis of variance. Even researchers with small handheld calculators can use this simple approach.

Get full access to this article

View all access options for this article.

References

Nunnally

J. C.

Bernstein

I. H.

(1994) Psychometric theory. (3rd ed.) New York: McGraw-Hill.

Shrout

P. E.

Fleiss

J. L.

(1979) Intraclass correlations: uses in assessing rater reliability. Psychological Bulletin, 86, 420–428.