The effects of stem orientation (positively stated stem or negatively stated stem) and completeness (complete stem or incomplete stem) of multiple-choice items were studied experimentally. Provisions were also made for determining possible interactions between orientation, completeness, and achievement. Thus, subjects (142 senior education students) were classified into three achievement groups (Low, Medium, High). A three-way factorial design (orientation x completeness x achievement) was used as the experimental model. Results indicated that incomplete versus complete stems increased item difficulty but had no effect on discrimination. Stem orientation had no effect on either difficulty or discrimination. Neither orientation nor completeness interacted with achievement or with each other. The implications of the results are discussed.
Get full access to this article
View all access options for this article.
References
1.
Aiken, L. R. (1987). Testing with multiple-choice items. Journal of Research and Development in Education, 20, 44-58.
2.
Aiken, L. R. (1982). Writing multiple-choice items to measure higher-order educational objectives. Educational And Psychological Measurement, 42, 803-806.
3.
Costin, F. (1972). Three-choice versus four-choice items: Implications for reliability and validity of objective achievement tests. Educational And Psychological Measurement, 32, 1035-1038.
4.
Cunningham, G. K. (1986). Educational and Psychological Measurement. New York: Macmillan.
5.
Dudycha, A. L. and Carpenter, J. R. (1973). Effects of item format on item discrimination and difficulty. Journal of Applied Psychology, 58, 116-121.
6.
Duncan, G. T. and Milton, E. O. (1978). Multiple answer multiple-choice test items: responding and scoring through Bayes and minimax strategies. Psychometrika, 43, 43-57.
7.
Dunn, T. F. and Goldstein, L. G. (1959). Test difficulty, validity and reliability as functions of selected multiple-choice item construction principles. Educational And Psychological Measurement, 19, 171-179.
8.
Frederiksen, N. (1986). Toward a broader conception of human intelligence. American Psychologist, 41, 445-452.
9.
Green, K. (1984). Effects of item characteristics on multiple-choice items difficulty. Educational And Psychological Measurement, 44, 551-561.
10.
Gronlund, N. E. (1985). Measurement and Evaluation in Teaching. (5th ed.). New York: Macmillan.
11.
Hopkins, K. D. and Stanley, J. C. (1981). Educational and Psychological Measurement and Evaluation. (6th ed.). Englewood Cliffs, NJ: Prentice-Hall.
12.
Hughes, H. H. and Trimble, V. (1965). The use of complex alternatives in multiple choice items. Educational And Psychological Measurement, 25, 117-126.
13.
Huttenlocher, J. (1962). Some effects of negative instances on the formation of simple concepts. Psychological Reports, 11, 35-42.
14.
Lyman, H. B. (1986). Test Scores and What They Mean. Englewood Cliffs, NJ: Prentice-Hall.
15.
McMorris, R. F. , Brown, J. A., Snyder, G. W., and Pruzek, R. M. (1972). Effects of violating item construction principles. Journal of Educational Measurement, 9, 287-295.
16.
Reynolds, W. M. (1979). Utility of multiple-choice test formats with mildly retarded adolescents. Educational And Psychological Measurement, 39, 325-331.
17.
Rimland, B. (1960). The effect of varying time limits and use of "'right answer not given" in experimental forms of the U.S. Navy Arithmetic Test. Educational And Psychological Measurement, 20, 533-539.
18.
Straton, R. G. and Catts, R. M. (1980). Comparison of two, three and four-choice item tests given a fixed total number of choices. Educational And Psychological Measurement, 40, 357-365.
19.
Tollefson, N. (1987). A comparison of the item difficulty and item discrimination of multiple-choice items using the "none of the above" and one correct response options. Educational And Psychological Measurement, 47, 377-383.
20.
Violato, C. and Harasym, P. H. (1987). Effects of structural characteristics of stem format of multiple-choice items on item difficulty and discrimination. Psychological Reports, 60, 1259-1262.
21.
Wakefield, J. A. (1958). Does the fifth choice strengthen a test item?Public Personnel Review, 19, 45-48.
22.
Wason, P. C. (1961). Response to affirmative and negative binary statements. British Journal of Psychology, 52, 133-142.
23.
Wesman, A. G. and Bennett, G. K. (1946). The use of "none of these" as an option in test construction. Journal of Educational Psychology, 27, 541-549.
24.
Wilcox, R. C. (1985). Estimating the validity of a multiple-choice test item having k correct alternatives. Applied Psychological Measurement, 9, 311-316.
25.
Williamson, M. L. and Hopkins, K. D. (1967). The use of ";none of these" versus homogeneous alternatives on multiple-choice tests: Experimental reliability and validity comparisons. Journal of Educational Measurement, 4, 53-57.
26.
Zern, D. (1967). Effects of variations in question-phrasing on true-false answers by grade-school children. Psychological Reports, 20, 527-533.
