The methods of alpha-stratified adaptive testing and constrained adaptive testing with shadow tests are combined. The advantages are twofold: First, application of the shadow test approach allows the implementation of any type of constraint on item selection in alpha-stratified adaptive testing. Second, the result yields a simple set of constraints that can be used in any application of the shadow test approach to reduce overexposure and underexposure of the items in the pool. An example from the Law School Admission Test is used to demonstrate the advantages.
Chang, H., & van der Linden, W.J. (2002). Optimal stratification of item pools in alpha-stratified computerized adaptive testing. Manuscript submitted for publication.
2.
Chang, H., Qian, J., & Ying, Z. (2001). A-stratified multistage CAT with b-blocking. Applied Psychological Measurement, 24, 333-341.
Hambleton, R.K., & Swaminathan, H. (1985). Item response theory: Principles and applications. Boston: Kluwer-Nijhoff.
5.
ILOG, Inc. (2000). CPLEX 6.6 [Computer program and manual]. Incline Village, NV: Author.
6.
Lord, F.M. (1983). Unbiased estimators of ability parameters, of their variance, and of their parallel-forms reliability. Psychometrika, 48, 233-246.
7.
Lord, F.M., & Novick, M.R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
8.
Parshall, C., Hogarty, K., & Kromrey, J. (1999, June). Item exposure in adaptive tests: An empirical investigation of control strategies. Paper presented at the annual meeting of the Psychometric Society, Lawrence, KS.
9.
Samejima, F. (1993). The bias function of the maximum likelihood estimate of ability for the dichotomous response level. Psychometrika, 58, 195-210.
10.
Stocking, M.L. (1998). A framework for comparing adaptive test designs. Unpublished manuscript, Princeton, NJ: Educational Testing Service.
11.
Stocking, M.L., & Lewis, C. (1998). Controlling item exposure conditional on ability in computerized adaptive testing. Journal of Educational and Behavioral Statistics, 23, 57-75.
12.
Stocking, M.L., & Lewis, C. (2000). Methods of controlling the exposure of items in CAT. In W.J. van der Linden & C.A.W. Glas (Eds.), Computerized adaptive testing: Theory and practice (pp. 163-182). Boston: Kluwer.
13.
Stocking, M.L., & Swanson, L. (1993). A method for severely constrained item selection in adaptive testing. Applied Psychological Measurement, 17, 277-292.
14.
Sympson, J.B., & Hetter, R.D. (1985, October). Controlling item-exposure rates in computerized adaptive testing. Proceedings of the 27th annual meeting of the Military Testing Association (pp. 973-977). San Diego, CA: Navy Personnel Research and Development Center.
15.
van der Linden, W.J. (Ed.). (1998). Optimal test assembly of psychological and educational tests. Applied Psychological Measurement, 22, 195-211.
16.
van der Linden, W.J. (2000). Constrained adaptive testing with shadow tests. In W.J. van der Linden & C.A.W. Glas (Eds.), Computerized adaptive testing: Theory and practice (pp. 27-52). Boston: Kluwer.
17.
van der Linden, W.J. (2001). Adaptive testing with equated number-correct scoring. Applied Psychological Measurement, 25, 343-355.
18.
van der Linden, W.J. (2003). Some alternatives to Sympson-Hetter item-exposure control in computerized adaptive testing. Journal of Educational and Behavioral Statistics, 28.
19.
van der Linden, W.J., & Glas, C.A.W. (2000). Capitalization on item calibration error in adaptive testing. Applied Measurement in Education, 12, 35-53.
20.
van der Linden, W.J., & Pashley, P.J. (2000). Item selection and ability estimation in adaptive testing. In W.J. van der Linden & C.A.W. Glas (Eds.), Computerized adaptive testing: Theory and practice (pp. 1-25). Norwell, MA: Kluwer Academic.
21.
van der Linden, W.J., & Reese, L.M. (1998). A model for optimal constrained adaptive testing. Applied Psychological Measurement, 22, 259-270.
22.
van der Linden, W.J., Scrams, D.J., & Schnipke, D.L. (1999). Using response-time constraints to control for differential speededness in adaptive testing. Applied Psychological Measurement, 23, 195-210.
23.
Veldkamp, B.P., & van der Linden, W.J. (2002). Multidimensional adaptive testing with constraints on test content. Psychometrika, pp. 575-588.
