Binary, probability, and ordinal scoring proce dures for multiple-choice items were examined. In a situation where true scores were experimentally controlled by the manipulation of partial informa tion, it was found that both the probability and or dinal scoring systems were more reliable than the binary scoring method. A second experiment using vocabulary items and standard reliability estimation procedures also showed higher reliability for the two partial information scoring methods relative to binary scoring.
Get full access to this article
View all access options for this article.
References
1.
Coombs, C.H., Milholland, J.E., & Womer, J.F.B.The assessment of partial knowledge. Educational and Psychological Measurement, 1956, 16, 13-37.
2.
de Finetti, B.Methods for discriminating levels of partial knowledge concerning a test item . British Journal of Mathematical and Statistical Psychology , 1965, 18, 87-123.
Lord, F.M., & Novick, M.R.Statistical theories of mental test scores. Reading, MA : Addison-Wesley, 1968.
5.
Nicewander, A.A theoretical comparison of the reliability of right-wrong scoring of multiple-choice tests vs. a rank-order responding and scoring system. Paper presented at the meeting of the Midwestern Psychological Association , Chicago, 1973.
6.
Poizner, S.Alternative responding and scoring methods for multiple-choice tests. Unpublished master's thesis, University of Oklahoma, 1974.
7.
Shuford, E.H., Albert, A., & Massengill, H.E.Admissible probability measurement procedures . Psychometrika, 1966, 31, 125-145.
