The purpose of this paper is to describe a method of indexing interobserver reliability from data relating to mutually exclusive nominal categories. The computer program to be described computes estimates of reliability from nominal data collected in a time interval manner. A specified critical time interval, the order of the responses, and the number of responses are important factors in computing the amount of agreement between judges.
Get full access to this article
View all access options for this article.
References
1.
Flanders, N. A.The problems of observer training and reliability. In E. J. Amidon and J. B. Hough (Eds.) Interaction Analysis: Theory, Research, and Application. Reading, Mass.Addison-Wesley, 1967.
2.
Scott, E. A., Reliability of content analysis: The case for nominal scale coding. Public Opinion Quarterly , 1955, 19, 321-325.
