A Monte Carlo study was conducted using item-examinee sampling procedures to examine the standard error of estimate for a given test's mean and variance. The main variables considered were test length, item difficulty, and item discrimination. The results indicate that optimal estimates, i.e., smallest standard error, of both mean and variance from a single item-examinee sampling plan may not be possible.
Get full access to this article
View all access options for this article.
References
1.
Barcikowski, R. S.Optimum use of the item sampling technique in obtaining test norms. Paper presented at the annual meeting of the American Educational Research Association , March, 1970.
2.
Barcikowski, R. S.A Monte Carlo study of item sampling (versus traditional sampling) for norm construction. Journal of Educational Measurement, 1972,
3.
Burton, N. W. and Remer, R.An empirical application of the item sampling technique to questionnaire data. Paper presented at the meeting of the National Council On Measurement In Education, Chicago, April, 1972.
4.
Knapp, T. R.An application of balanced incomplete block designs to the estimation of test norms. EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1968, 28, 265-272.
5.
Loadman, W. E.An inquiry concerning the use of item sampling as a method to reduce testing time in an evaluation study . Paper presented at the meeting of the National Council on Measurement in Education, Chicago, April, 1972.
6.
Lord, F. M.Estimating norms by item-sampling . EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1962, 22, 259-267.
7.
Lord, F. M. and Novick, M. R.Statistical theories of mental test scores. Reading, Massachusetts: Addison-Wesley , 1968.
8.
Piper, R. M.Multiple-matrix sampling in the evaluation of a music program. Paper presented at the meeting of the National Council on Measurement in Education, Chicago , April, 1972.
9.
Shoemaker, D. M.Allocation of item and examinee in estimating a norm distribution by item-sampling. Journal of Educational Measurement, 1970, 7, 123-128. (a)
10.
Shoemaker, D. M.Item-examinee sampling procedure and associated standard errors in estimating test parameters. Journal of Educational Measurement, 1970, 7, 255-262. (b)
11.
Shoemaker, D. M.An application of item-examinee scaling attitudes. Journal of Educational Measurement, 1971, 8, 279-282. (a)
12.
Shoemaker, D. M.Further results on the standard errors of estimate associated with item-examinee sampling procedures. Journal of Educational Measurement, 1971, 8, 215-220. (b)
13.
Tucker, L. R.Maximum validity of a test with equivalent items. Psychometrika, 1946, 11, 1-13.
