A FORTRAN subroutine is presented to calculate a generalized measure of agreement between multiple raters and a set of correct responses at any level of measurement and among multiple responses, along with the associated probability value, under the null hypothesis.
Get full access to this article
View all access options for this article.
References
1.
Berry, K. J. , & Mielke, P. W. (1988). A generalization of Cohen's kappa agreement measure to interval measurement and multiple raters. Educational and Psychological Measurement, 48, 921-933.
2.
Berry, K. J. , & Mielke, P. W. (1990). A generalized agreement measure. Educational and Psychological Measurement, 50, 123-125.
3.
Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37-46.
4.
Guetzkow, H. (1950). Unitizing and categorizing problems in coding qualitative data. Journal of Clinical Psychology, 6, 47-58.
5.
Hubert, L. (1977). Kappa revisited. Psychological Bulletin, 84, 289-297.
6.
Light, R. J. (1971). Measures of response agreement for qualitative data: Some generalizations and alternatives. Psychological Bulletin, 76, 365-377.
7.
Tukey, J. W. (1950). Discussion on symposium on statistics for the clinician. Journal of Clinical Psychology, 6, 61-74.
