The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of Reliability

Abstract

Get full access to this article

View all access options for this article.

References

Burdock, E. I. , Fleiss, J. L. , and Hardesty, A. S. A new view of inter-observer agreement. Personnel Psychology , 1963, 16, 373-384.

Cohen, J. A coefficient of agreement for nominal scales. EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1960, 20, 37-46.

Cohen, J. Weighted kappa: Nominal scale agreement with provision for scaled disagreement or partial credit: Psychological Bulletin, 1968, 70, 213-220. (a)

Cohen, J. Multiple regression as a general data-analytic system. Psychological Bulletin, 1968, 70, 426-443. (b)

Everitt, B. S. Moments of the statistics kappa and weighted kappa. British Journal of Mathematical and Statistical Psychology, 1968, 21, 97-103.

Fleiss, J. L. , Cohen, J. and Everitt, B. S. Large sample standard errors of kappa and weighted kappa. Psychological Bulletin, 1969, 72, 323-327.

Krippendorff, K. Bivariate agreement coefficients for reliability of data. In E. F. Borgatta and G. W. Bohrnstedt (Eds.) Social Methodology 1970. San Francisco: Jossey-Bass, 1970.

Lehmann, E. L. Testing statistical hypotheses . New York: Wiley, 1959.

Scheffé, H. The analysis of variance. New York: Wiley, 1959 .

10.

Shepard, R. N. The analysis of proximities: Multidimensional scaling with an unknown distance function. I. Psychometrika, 1962, 27, 125-140.

11.

Spitzer, R. L. , Cohen, J. , Fleiss, J. L. and Endicott, J. Quantification of agreement in psychiatric diagnosis. Archives of General Psychiatry , 1967, 17, 83-87.

12.

Spitzer, R. L. and Endicott, J. Diagno: A computer program for psychiatric diagnosis utilizing the differential diagnostic procedure. Archives of General Psychiatry, 1968, 18, 746-756.

13.

Spitzer, R. L. and Endicott, J. Diagno II: Further developments in a computer program for psychiatric diagnosis. American Journal of Psychiatry , 1969, 125 (Jan. supp.), 12-21.

14.

Spitzer, R. L. , Fleiss, J. L. , Endicott, J. and Cohen, J. Mental status schedule: Properties of factor-analytically derived scales. Archives of General Psychiatry, 1967, 16, 479-493.