The purpose of this paper is to demonstrate the formal equivalence of Cohen's weighted kappa (1960, 1968) and the del measure of prediction analysis techniques developed by Hildebrand, Laing, and Rosenthal in 1977 and of their sampling variances. This equivalence leads to interesting extensions of each statistic. In particular, two extensions are presented here: a measure of the maximum value of del is introduced, and a measure of precision for kappa is presented. Other possibilities are suggested for future research.
Get full access to this article
View all access options for this article.
References
1.
CohenJ.A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 1960, 20, 37–46.
2.
CohenJ.Weighted kappa: Nominal scale agreement with provision for scaled disagreement or partial credit. Psychological Bulletin, 1968, 70, 213–220.
3.
CohenJ.Weighted chi square: An extension of the kappa method. Educational and Psychological Measurement, 1972, 32, 61–74.
4.
FleissJ. L.CohenJ., & EverittB. S.Large sample standard errors of kappa and weighted kappa. Psychological Bulletin, 1969, 72, 323–327.
5.
HarrisC. W.PearlmanA. P., & WilcoxR. R.Achievement test items—methods of study. CSE Monograph Series in Evaluation, 1977, No. 6.
6.
HildebrandD. K.LaingJ. D., & RosenthalH.Prediction logic: A method for empirical evaluation of formal theory. Journal of Mathematical Sociology, 1974, 3, 163–185.
7.
HildebrandD. K.LaingJ. D., & RosenthalH.Prediction analysis of cross-classifications. New York: Wiley, 1977.
