A computer program entitled Program STANDARD is presented which assesses the significance of the conjoint agreement of many observers with a standard or "correct" set of choices for assignments of subjects or objects on nominal scales.
Get full access to this article
View all access options for this article.
References
1.
Cohen, J.A coefficient of agreement for nominal scales. EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1960, 20, 37-46.
2.
Fleiss, J. L.Measuring nominal scale agreement among many raters. Psychological Bulletin, 1971, 76, 378-382.
3.
Guetzkow, H.Utilizing and categorizing problems in coding qualitative data. Journal of Clinical Psychology , 1950, 6, 47-58.
4.
Light, R. J.Measures of response agreement for qualitative data: Some generalizations and alternatives. Psychological Bulletin, 1971, 76, 365-377.
5.
Tukey, J. W.Discussion on symposium. Journal of Clinical Psychology, 1950, 6, 61-74.
6.
Watkins, M. W., and McDermott, P. A.A computer program for measuring levels of overall and partial congruence among multiple observers on nominal scales. EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1979, 39, in press.