Six computational methods for assembling tests from a bank with an item-set structure, based on mixed-integer programming, are presented. The methods were evaluated using mathematical programming problem feasibility and expected solution times. Two item banks with a set structure from the Law School Admission Test were used to illustrate application of the methods. Solutions were found that satisfied all constraints within short computing times. The best approximations to the target information functions were obtained for the methods that simultaneously selected the stimuli and items for the set-based items.
Get full access to this article
View all access options for this article.
References
1.
Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In F. M. Lord and M. R. Novick (Eds.), Statistical theories of mental test scores. Reading MA: Addison-Wesley.
2.
Bradlow, A. T. , Wainer, H., & Wang, X. (1999). A Bayesian random effects model for testlets. Psychometrika, 64, 153–169.
3.
Fan, M. (1997, June). A comparison of computerized test assembly programs for constructing parallel test forms. Paper presented at the annual meeting of the Psychometric Society, Gatlinburg TN.
Luecht, R. M. (1998). Computer-assisted test assembly using optimization heuristics. Applied Psychological Measurement, 22, 224–236.
6.
Luecht, R. M. , & Hirsch, T. M. (1991, June). Computerized test construction of parallel forms with problem-linked items. Paper presented at the Annual Meeting of the Psychometric Society, New Brunswick NJ.
7.
Luecht, R. M,. & Hirsch, T. M. (1992). Computerized test construction using average growth approximation of target information functions. Applied Psychological Measurement, 16, 41–52.
8.
Rosenbaum, P. R. (1987). A note on item bundles. Psychometrika, 53, 349–360.
9.
Swanson, L. , & Stocking, M. L. (1993). A model and heuristic for solving very large item selection problems. Applied Psychological Measurement, 17, 151–166.
10.
Timminga, E. , van der Linden, W. J., & Schweizer, D. A. (1996). ConTEST 2.0: A decision support system for item banking and optimal test assembly[Computer program and manual]. Groningen, The Netherlands: iec ProGAMMA.
11.
van der Linden, W. J. (1992). Selecting passagebased items for achievement tests[Internal report]. Iowa City IA: American College Testing.
12.
van der Linden, W. J. (1998). Optimal assembly of psychological and educational tests. Applied Psychological Measurement, 22, 195–211.
13.
van der Linden, W. J. (2000). Constrained adaptive testing with shadow tests. In W. J. van der Linden & C. A. W. Glas (Eds.), Computerized adaptive testing: Theory and practice(pp. 27–52). Boston: Kluwer.
14.
van der Linden, W. J. , & Adema, J. J. (1998). Simultaneous assembly of multiple test forms. Journal of Educational Measurement, 35, 185–198.
15.
van der Linden, W. J. , & Boekkooi-Timminga, E. (1989). A maximin model for test design with practical constraints. Psychometrika, 54, 237–247.
16.
van der Linden, W. J. , & Reese, L. M. (1998). A model for optimal constrained adaptive testing. Applied Psychological Measurement, 22, 259–270.
17.
Wainer, H. , & Kiely, G. L. (1987). Item clusters and computerized adaptive testing: A case for testlets. Journal of Educational Measurement, 24, 185–202.
18.
Yen, W. (1993). Scaling performance assessments: Strategies for managing local dependence. Journal of Educational Measurement, 30, 187–213.
