In response to an article by de Gruijter and Ham bleton (1984), some thoughts on the use of decision theory for setting cutoff scores on mastery tests are presented. This paper argues that decision theory of fers much more than suggested by de Gruijter and Hambleton and that an attempt at evaluating its poten tials for mastery testing should address the full scale of possibilities. As for the problems de Gruijter and Hambleton have raised, some of them disappear if proper choices from decision theory are made, while others are inherent in mastery testing and will be en countered by any method of setting cutoff scores. Fur ther, this paper points at the development of new tech nology to assist the mastery tester in the application of decision theory. From this an optimistic attitude to wards the potentials of decision theory for mastery testing is concluded.
Get full access to this article
View all access options for this article.
References
1.
Berk, R.A. (1976). Determination of optimal cutting scores in criterion-referenced measurement. Journal of Experimental Education, 45, 4-9.
2.
Cronbach, L.J., & Gleser, G.L. (1965). Psychological tests and personnel decisions (2nd ed.). Urbana IL: University of Illinois Press.
3.
de Gruijter, D.N.M., & Hambleton, R.K. (1984). On problems encountered using decision theory to set cutoff scores. Applied Psychological Measurement, 8, 1-8.
4.
Ferguson, T.S. (1967). Mathematical statistics; A decision theoretic approach. New York: Academic Press .
5.
Glass, G.V. (1978). Standards and criteria. Journal of Educational Measurement, 15, 237-261.
6.
Gross, A.L., & Su, W.H. (1975). Defining a "fair" or "unbiased" selection model: A question of utilities. Journal of Applied Psychology, 60, 345-351.
7.
Hambleton, R.K. (1978). On the use of cut-off scores with criterion-referenced tests in instructional settings. Journal of Educational Measurement , 15, 277-290.
8.
Hambleton, R.K., & Novick, M.R. (1973). Toward an integration of theory and method for criterion-referenced tests. Journal of Educational Measurement , 10, 159-170.
9.
Huynh, H. (1980). A nonrandomized minimax solution for passing scores in the binomial error model. Psychometrika, 45, 167-182.
10.
Mellenbergh, G.J., Koppelaar, H., & van der Linden, W.J. (1977). Dichotomous decisions based on dichotomously scored items: A case study. Statistica Neerlandia, 31, 161-169.
11.
Mellenbergh, G.J., & van der Linden, W.J. (1981). The linear utility model for optimal selection. Psychometrika, 46, 283-293.
12.
Novick, M.R., Isaacs, G.L., & Dekeyrel, D.F. (1977). Computer-assisted data analysis-1977. Manual for the computer-assisted data analysis (CADA) monitor . Iowa City IA: Iowa Testing Programs .
13.
Petersen, N.S., & Novick, M.R. (1976). An evaluation of some models for culture-fair selection. Journal of Educational Measurement, 13, 3-29.
14.
Popham, J.W. (1978). As always, provocative. Journal of Educcationcal Measurement, 15, 297-300.
15.
van derLinden, W.J. (1980). Decision models for use with criterion-referenced tests. Applied Psychological Measurement, 4, 469-492.
16.
van der Linden, W.J. (1981). Using aptitude measurements for the optimal assignment of subjects to treatmeats with and without mastery scores. Psychometrika, 46, 257-274.
17.
van der Linden, W.J. (1982a). Criterion-referenced measurements: Its main applications, problems, and findings. In W. J. van der Linden (Ed.), Aspects of criterion-referenced measurement. Evaluation in Education: An International Review Series, 5, 97-118.
18.
van der Linden, W.J. (1982b). A latent trait method for determining intrajudge inconsistency in the Angoff and Nedelsky techniques of standard setting. Journal QfEducational Measurement, 19, 295-308.
19.
van der Linden, W.J. (in press). Decision theory in educational research and testing. In T. Husen & T. H. Postlethwaite, International encyclopedia of education: Research and studies. Oxford: Pergamon Press.
20.
van der Linden, W.J., & Mellenbergh, G.J. (1977). Optimal cutting scores using a linear loss function. Applied Psychological Measurement , 1, 593-599.
21.
Veldhuijzen, N.H. (1982). Setting cutting scores: A minimum information approach. In W. J. van der Linden (Ed.), Aspects of criterion-referenced measurement. Evaluation in Education: An International Review Series, 5, 141-148.
22.
Vijn, P., & Molenaar, I.W. (1981). Robustness regions for dichotomous decisions. Journal of Educational Statistics, 6, 205-235.
23.
Zieky, M.J., & Livingston, S.A. (1977). Manual for setting standards on the Basic Skills Assessment Tests. Princeton NJ: Educational Testing Service.
