A new coefficient for measuring agreement on bidirectional response continua, called ψ*, is presented. ψ* is based on Holley and Guilford's "G index of agreement," which is restricted to measuring agreement in 2 × 2 tables. ψ* instead is designed to measure agreement in larger square contingency tables with even numbers of rows and columns. ψ* avoids some of the shortcomings of other measures of agreement; it is, e.g., independent of scale direction.
Get full access to this article
View all access options for this article.
References
1.
Aiken, L. R. (1980). Content validity and reliability of single items or composites. Educational and Psychological Measurement, 40, 955-959.
2.
Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45, 131-142.
3.
Davenport, E. C., Jr. (1987). The G coefficient and its relation to R-type factor analysis. Educational and Psychological Measurement, 47, 349-357.
4.
Galtung, J. (1970). Theory and methods of social research. Oslo: Universitetsforlaget.
5.
Holley, W. and Guilford, J. P. (1964). A note on the G index of agreement. Educational and Psychological Measurement, 24, 749-753.
6.
Lienert, G. A. (1973). On a generalized G index of agreement. Educational and Psychological Measurement, 33, 767-772.
7.
Schlosser, O. (1976). Einfuhrung in die sozialwissenschaftliche Zusanimenhangsanalyse. Reinbek: Rowohlt.
