In various situations, a multiple-choice test item may have more than one correct alternative, and the goal is to determine how many correct alternatives an examinee actually knows. For a randomly sampled ex aminee, the validity of an item is defined as the prob ability of deciding that the examinee knows i correct alternatives, when in fact exactly i correct alternatives are known. This article describes how latent class models can be used to estimate this probability.
Get full access to this article
View all access options for this article.
References
1.
Ashler, D. (1979). Biserial estimators in the presence of guessing . Journal of Educational Statistics, 4, 325- 355.
2.
Barlow, R., Bartholomew, D., Bremner, J., & Brunk, H. (1972). Statistical inference under order restrictions . New York: Wiley.
3.
Birenbaum, M., & Tatsuoka, K. (1982). On the dimensionality of achievement test data . Journal of Educational Measurement, 19, 259-266.
4.
Bliss, L.B. (1980). A test of Lord's assumption regarding examinee guessing behavior on multiple-choice tests using elementary school students . Journal of Educational Measurement, 17, 147-153.
5.
Coombs, C.H., Milholland, J.E., & Womer, F.B. (1956). The assessment of partial knowledge. Educational and Psychological Measurement, 16, 13-37.
6.
Cross, L.H., & Frary, R.B. (1977). An empirical test of Lord's theoretical results regarding formula-scoring of multiple-choice tests. Journal of Educational Measurement, 14, 313-321.
7.
Duncan, G.T., & Milton, E.O. (1978). Multiple answer multiple-choice test items: Responding and scoring through Bayes and minimax strategies. Psychometrika , 43, 43-57.
8.
Dykstra, R.L., & Robertson, T. (1982). An algorithm for isotonic regression for two or more independent variables. Annals of Statistics, 10, 708-716.
9.
Gibbons, J.D., Olkin, I., & Sobel, M. (1979). A subset selection technique for scoring items on a multiple-choice test. Psychometrika, 44, 259-270.
10.
Katti, S.K. (1973). Exact distribution for the chi-square test in the one-way table. Communications in Statistics, 2, 435-457.
11.
Robertson, T. (1978). Testing for and against an order restriction on multinomial parameters. Journal of the American Statistical Association,73, 197-202.
12.
Robertson, T., & Wright, F.I. (1981). Likelihood ratio tests for and against a stochastic ordering between multinomial populations. Annals of Statistics , 9, 1248-1257.
13.
Schmittlein, D.C. (1984). Assessing validity and testretest reliability for "pick k of n" data. Marketing Science, 3, 23-40.
14.
Smith, P.J., Rae, D.S., Manderscheid, R., & Silberg, S. (1979). Exact and approximate distributions of the chi-square statistics for equiprobability. Communications in Statistics— Simulation and Computation, B8, 131-149.
15.
Subkoviak, M. (1978). Empirical investigation of procedures for estimating reliability for mastery tests. Journal of Educational Measurement , 15, 111-116.
16.
Weitzman, R.A. (1970). Ideal multiple-choice items. Journal of the American Statistical Association,65, 71-89.
17.
Wilcox, R.R. (1980). Determining the length of a criterion-referenced test. Applied Psychological Measurement, 4, 425-446.
18.
Wilcox, R.R. (1982a). A comment on approximating the χ2 distribution in the equiprobable case. Communications in Statistics—Simulation and Computation, 11, 619-623.
19.
Wilcox, R.R. (1982b). Some empirical and theoretical results on an answer-until-correct scoring procedure. British Journal of Mathematical and Statistical Psychology, 35, 57-70.
20.
Wilcox, R.R. (1982c). Some new results on an answer-until-correct scoring procedure. Journal of Educational Measurement, 19, 67-74.
21.
Wilcox, R.R. (1983a). An approximation of the k out of n reliability of a test and a scoring procedure for determining which items an examinee knows. Psychometrika, 48, 211-222.
22.
Wilcox, R.R. (1983b). How do examinees behave when taking multiple-choice tests?Applied Psychological Measurement, 7, 239-240.
23.
Zehna, P.W. (1966). Invariance of maximum likelihood estimation. Annals of Mathematical Statistics, 37, 744.
