Chang & Ying’s (1999) computerized adaptive testing item-selection procedure stratifies the item bank according to a parameter values and requires b parameter values to be evenly distributed across all strata. Thus, a and b parameter values must be incorporated into how strata are formed. A refinement is proposed, based on Weiss’ (1973) stratification of items according to b values. Simulation studies using a retired item bank of a Graduate Record Examination test indicate that the new approach improved control of item exposure rates and reduced mean squared errors.
Get full access to this article
View all access options for this article.
References
1.
Chang, H.-H. , & Ying, Z. (1996). A global information approach to computerized adaptive testing. Applied Psychological Measurement, 20, 213–229.
Chang, H.-H. , & Zhang, J. (in press). Hypergeometric family and item overlap rates in computerized adaptive testing. Psychometrika.
4.
Eggen, T. J. H. M. (1999) Item selection in adaptive testing with the sequential probability ratio test. Applied Psychological Measurement, 23, 249–261.
5.
Leung, C.-K. , Chang, H.-H., & Hau, K.-T. (2001, April). Integrating stratification and information approaches for multiple constrained CAT. Paper presented at the annual meeting of the National Council on Measurement in Education, Seattle.
6.
Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale NJ: Erlbaum.
7.
Lord, F. M. , & Wingersky, M. S. (1984). An investigation of methods for reducing sampling error in certain IRT procedures. Applied Psychological Measurement, 8, 347–364.
8.
McBride, J. R. , & Martin, J. T. (1983). Reliability and validity of adaptive verbal ability tests in a military setting. In D. J. Weiss (Ed.), New horizons in testing: Latent trait test theory and computerized adaptive testing (pp. 223–236). New York: Academic Press.
9.
Parshall, C. , Davey, T., & Nering, M. (1998, April). Test development exposure control for adaptive tests. Paper presented at the annual meeting of the National Council on Measurement in Education, San Diego CA.
10.
Parshall, C. , Hogarty, K., & Kromrey, J. (1999, June). Item exposure in adaptive tests: An empirical investigation of control strategies. Paper presented at the annual meeting of the Psychometric Society, Lawrence KS.
11.
Stocking, M. L. , & Lewis, C. (1995). A new method of controlling item exposure in computerized adaptive testing (Research Report No. 95-25). Princeton NJ: Educational Testing Service.
12.
Sympson, J. B. , & Hetter, R. D. (1985, October). Controlling item-exposure rates in computerized adaptive testing. Proceedings of the 27th annual meeting of the Military Testing Association (pp. 973–977). San Diego CA: Navy Personnel Research and Development Center.
13.
Thomasson, G. L. (1995, June). New item exposure control algorithms for computerized adaptive testing. Paper presented at the annual meeting of the Psychometric Society, Minneapolis MN.
14.
van der Linden, W. J. (1998). Optimal assembly of psychological and educational tests. Applied Psychological Measurement, 22, 195–211.
15.
Weiss, D. J. (1973). The stratified adaptive computerized ability test (Research Report No. 73-3). Minneapolis MN: University of Minnesota, Department of Psychology, Computerized Adaptive Testing Laboratory.
