Little research has been conducted on the use of linear polychotomous scoring of multiple-choice test items. Therefore, several tests were analyzed using both dichotomous and polychotomous scoring of test items to assess how the alpha reliabilities of the tests change based on the type of scoring used. In each case, the alpha reliabilities of the tests increased, with the same or fewer number of items in each test, when polychotomous (vs dichotomous) scoring of multiple-choice test items was used.
Get full access to this article
View all access options for this article.
References
1.
CrockerL.AlginaJ. (1986) Introduction to classical and modern test theory. Fort Worth, TX: Harcourt Brace.
2.
HaladynaT. M.SympsonJ. B. (1988) Empirically based polychotomous scoring of multiple-choice test items: historical overview, Paper presented in DavisC. E. (Chair), New developments in polychotomous item scoring and modeling. Symposium conducted at the annual meeting of the American Educational Research Association, New Orleans, LA.
3.
SympsonJ. B. (1988) A procedure for linear polychotomous scoring of test items. Paper presented at the Office of Naval Research Conference on Model-based Psychological Measurement, Iowa City, LA.
4.
SympsonJ. B. (1990) POLy: a computer program for polychotomous item analysis. (Release date 06/15/90) El Toro, CA: Analytic Systems.
5.
SympsonJ. B.DavisonM. L. (1989) Reducing test length with polychotomous scoring. Paper presented at the annual meeting of the American Educational Research Association, San Francisco, CA.
6.
SympsonJ. B.HaladynaT. M. (1988) An evaluation of polyweighting in domain-referenced testing. Paper presented in C. E. Davis (Chair), New developments in polychotomous item scoring and modeling Symposium conducted at the annual meeting of the American Educational Research Association, New Orleans, LA.