Program CRITREL, which is written in BASIC, FORTRAN, and PASCAL, is designed to compute the coefficient of agreement (pO) the kappa coefficient (k), and three linear transformations of these two coefficients, for estimating the reliability of a criterion-referenced test. The program also computes the right-tail hypergeometric and estimated normal curve probabilities of po and k. The program is designed primarily for estimating reliability, but it can be used to compute a validity coefficient for a criterion-referenced test when the dependent (predicted or concurrent) variable is dichotomous.
Get full access to this article
View all access options for this article.
References
1.
Berk, R. A. (1980). A consumer's guide to criterion-referenced test reliability. Journal of Educational Measurement, 17, 323-349.
2.
Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational And Psychological Measurement, 20, 37-46.
3.
Coons, D. F. (1978). A concise method for computing normal curve areas using a calculator. Educational And Psychological Measurement, 38, 653-655.
