A simple model of observation is proposed which allows for guessing. The proportion of agreement, G, and kappa indexes are shown to differ in how they correct for chance agreements between two observers. On the basis of the findings, it is suggested that no single agreement index is appropriate for all sets of data.
Get full access to this article
View all access options for this article.
References
1.
CohenJ.A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 1960, 20, 37–46.
2.
FleissJ. L.Measuring agreement between two judges on the presence or absence of a trait. Biometrics, 1975, 31, 651–659.
3.
HolleyW.GuilfordJ. P.A note on the G-index of agreement. Educational and Psychological Measurement, 1964, 24, 749–753.
