A subroutine is presented to calculate a generalized measure of agreement for multiple judges and multiple responses at any level of measurement, along with the associated probability value, under the null hypothesis.
Get full access to this article
View all access options for this article.
References
1.
Berry, K. J. and Mielke, P. W. (1988). A generalization of Cohen's kappa agreement measure to interval measurement and multiple raters. Educational and Psychological Measurement, 48, 921-933.
2.
Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37-46.
