This study compares two-option multiple-choice vocabulary test items with comparably written true-false test items. Results indicate that the multiple-choice format provides a significantly more reliable measure than the true-false format. Results further indicate that the true and false items do not appear to be measuring the same abilities. Potential strategies are discussed that an examinee may use for solving two-option multiple-choice and true-false test items in an effort to explain these results.
Get full access to this article
View all access options for this article.
References
1.
Budescu, D. V. and Nevo, B. (1985). Optimal number of options: An investigation of the assumption of proportionality.Journal of Educational Measurement, 22, 183-196.
2.
Costin, F. (1970). The optimal number of alternatives in multiple- choice achievement tests: Some empirical evidence for a mathematical proof.Educational and Psychological Measurement, 30, 353-358.
3.
Costin, F. (1972). Three-choice versus four-choice items: Implications for reliability and validity of objective achievement tests.Educational and Psychological Measurement, 32, 1035-1038.
4.
Ebel, R. L. (1969). Expected reliability as a function of choices per item.Educational and Psychological Measurement, 29, 565-570.
5.
Ebel, R. L. (1972). Essentials of educational measurement. Engle- wood Cliffs, NJ: Prentice-Hall, Inc.
6.
Ebel, R. L. (1975). Can teachers write good true-false test items?Journal of Educational Measurement, 12(1), 31-35.
7.
Ebel, R. L. (1982). Proposed solutions to two problems of test construction.Journal of Educational Measurement, 19(4), 267-278.
8.
Frisbie, D. A. (1973). Multiple-choice versus true-false: A comparison of reliability and concurrent validities.Journal of Educational Measurement, 10(4), 297-304.
9.
Frisbie, D. A. (1974). The effect of item format on reliability and validity: A study of multiple-choice and true-false achievement tests.Educational and Psychological Measurement, 34, 885-892.
10.
Green, K. (1979). Multiple-choice and true-false: Reliability and validity compared.Journal of Experimental Education, 48(1), 42-44.
11.
Green, K. , Sax, G., and Michael, W. B. (1982). Validity and reliability of tests having differing numbers of options for students of differing levels of ability.Educational and Psychological Measurement, 42(1), 239-245.
12.
Grier, J. B. (1975). The number of alternatives for optimum test reliability.Journal of Educational Measurement, 12(2), 109-113.
13.
Grier, J. B. (1976). The optimal number of alternatives at a choice point with travel time considered.Journal of Mathematical Psychology, 14, 91-97.
14.
Hakstian, A. R. and Whalen, T. E. (1976). A k-sample significance test for independent alpha coefficients.Psychometrika, 41(2), 219-231.
15.
Haladyna, T. M. and Downing, S. M. (1990a). A taxonomy of multiple-choice item-writing rules.Applied Measurement in Education2(1), 37-50.
16.
Haladyna, T. M. , and Downing, S. M. (199Gb). Validity of a taxonomy of multiple-choice item-writing rules.Applied Measurement in Education, 2(1), 51-78.
17.
Levine, M. V. and Drasgow, F. (1983). The relation between incorrect option choice and estimated reliability.Educational and Psychological Measurement, 43, 675-685.
18.
Lord, F. M. (1944). Reliability of multiple-choice tests as a function of number of choices per item.Journal of Educational Psychology, 35, 175-180.
19.
Lord, F. M. (1977). Optimal number of choices per item-a comparison of four approaches.Journal of Educational Measurement, 14(1), 33-38.
20.
Oosterhof, A. C. and Glasnapp, D. R. (1974). Comparative reliabilities and difficulties of the multiple-choice and true-false formats.Journal of Experimental Education, 42, 62-64.
21.
Ruch, G. M. and Charles, J. W. (1928). A comparison of five types of objective tests in elementary psychology.Journal of Applied Psychology, 12, 398-403.
22.
Ruch, G. M. , and Stoddard, G. D. (1925). Comparative reliabilities of objective examinations.Journal of Educational Psychology, 16, 89-103.
23.
Sax, G. (1989). Principles of educational and psychological measurement and evaluation (3rd ed.). Belmont, CA: Wadsworth Publishing Co.
24.
Storey, A. G. (1966). A review of evidence or the case against the true-false item.Journal of Educational Research, 59(6), 282-285.
25.
Straton, R. G. , and Catts, R. M. (1980). A comparison of two, three and four-choice item tests given a fixed total number of choices.Educational and Psychological Measurement, 40, 357-365.
26.
Trevisan, M. S. , Sax, G., and Michael, W. B. (1991). The effects of the number of options per item and student ability on test validity and reliability.Educational and Psychological Measurement, 51, 829-837.
27.
Tversky, A. (1964). On the optimal number of alternatives at a choice point.Journal of Mathematical Psychology, 1, 386-391.
28.
Williams, B. J. and Ebel, R. L. (1957). The effect of varying the number of alternatives per item on multiple-choice vocabulary test items.The 14th Yearbook of the National Council on Measurement in Education (pp. 63-65).
