For the measurement of multiple traits, this paper pro poses assembling tests based on the targets for the (as ymptotic) variance functions of the estimators of each of the traits. A linear programming model is presented that can be used to computerize the assembly process. Several cases of test assembly dealing with multidimensional traits are distinguished, and versions of the model appli cable to each of these cases are discussed. An empirical example of a test assembly problem from a two-dimen sional mathematics item pool is provided.
Ackerman, T.A. (1989, March). An alternative methodology for creating parallel test forms using the IRT information function. Paper presented at the annual meeting of the National Council on Measurement in Education, San Francisco.
2.
Ackerman, T.A. (1994). Creating a test information profile for a two-dimensional latent space. Applied Psychological Measurement, 18, 257-275.
3.
Adema, J.J. (1990). The construction of customized two-staged tests . Journal of Educational Measurement, 27, 241-253.
4.
Adema, J.J. (1992a). Implementations of the branch-and-bound method for test construction. Methodika, 6,99-117.
5.
Adema, J.J. (1992b). Methods and models for the construction of weakly parallel tests. Applied Psychological Measurement, 16, 53-63.
6.
Adema, J.J., Boekkooi-Timminga, E., & van der Linden, W.J. (1991). Achievement test construction using 0-1 linear programming. European Journal of Operations Research, 55, 103-111.
7.
Adema, J.J., & van der Linden, W.J. (1989). Algorithms for computerized test construction using classical item parameters. Journal of Educational Statistics, 14, 279-290.
Armstrong, R.D., Jones, D.H., & Wu, I.-L. (1992). An automated test development of parallel tests from a seed test. Psychometrika, 57, 271-288.
10.
Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee's ability. In F. M. Lord & M. R. Novick, Statistical theories of mental test scores (pp. 397-479). Reading MA: Addison-Wesley.
11.
Boekkooi-Timminga, E. (1987). Simultaneous test construction by zero-one programming . Methodika, 1, 101-112.
12.
Boekkooi-Timminga, E. (1990). The construction of parallel tests from IRT-based item banks. Journal of Educational Statistics, 15, 129-145.
13.
Feuerman, F., & Weiss, H. (1973). A mathematical programming model for test construction and scoring. Management Science, 19, 961-966.
14.
Kendall, M.G., & Stuart, A. (1976). The advanced theory of statistics (Vol. 2; 4th ed.). London : Griffin & Co.
15.
Luecht, R.M., & Hirsch, T.M. (1992). Computerized test construction using average growth approximation of target information functions. Applied Psychological Measurement, 16, 41-52.
16.
McKinley, R.L., & Reckase, M.N. (1983). An extension of the two-parameter logistic model to the multidimensional latent space (Research Rep. ONR 83-2. Iowa City IA: American College Testing.
17.
Nemhauser, G., & Wolsey, L. (1988). Integer and combinatorial optimization. New York: Wiley.
18.
Reckase, M.D. (1985). The difficulty of test items that measure more than one ability. Applied Psychological Measurement, 9, 401-412.
19.
Reckase, M.D. (1997). A linear logistic multidimensional model for dichotomous item response data. In W. J. van der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory (pp. 271-286). New York: Springer-Verlag.
20.
Samejima, F. (1974). Normal ogive model for the continuous response level in the multidimensional latent space. Psychometrika , 39, 111-121.
21.
Swanson, L., & Stocking, M.L. (1993). A model and heuristic for solving very large item selection problems. Applied Psychological Measurement, 17, 151-166.
22.
Theunissen, T.J.J.M. (1985). Binary programming and test design. Psychometrika, 50, 411-420.
23.
Timminga, E., & Adema, J.J. (1995). Test construction from item banks. In G. H. Fischer & I. W. Molenaar (Eds.), The Rasch model: Foundations, recent developments, and applications (pp. 111-127). New York: Springer-Verlag.
24.
Timminga, E., van der Linden, W.J., & Schweizer, D.A. (1996). ConTEST [Computer program and manual]. Groningen, The Netherlands: iec ProGAMMA.
25.
van der Linden, W.J. (1994). Optimum design in item response theory: Applications to test assembly and item calibration. In G. H. Fischer & D. Laming (Eds.), Contributions to mathematical psychology, psycho-metrics, and methodology (pp. 308-318). New York: Springer-Verlag .
26.
van der Linden, W.J., & Boekkooi-Timminga, E. (1988). A zero-one programming approach to Gulliksen's matched random subsets method. Applied Psychological Measurement, 12, 201-209.
27.
van derLinden, W.J., & Boekkooi-Timminga, E. (1989). A maximin model for test design with practical constraints. Psychometrika, 53, 237-247.
28.
van der Linden, W.J., & Luecht, R.M. (1996). An optimization model for test assembly to match observed-score distributions. In G. Engelhard & M. Wilson (Eds.), Objective measurement: Theory into practice (Vol. 3, pp. 405-418). Norwood NJ: Ablex Publishing Company.
29.
Votaw, D.F. (1952). Methods of solving some personnel classification problems. Psychometrika, 17, 255-266.
30.
Wagner, H.M. (1975). Principles of operations research (2nd ed.). London: Prentice/Hall .
31.
Yen, W.M. (1983). Use of the three-parameter model in the development of standardized achievement tests. In R. K. Hambleton (Ed.), Applications of item response theory (pp. 123-141). Vancouver: Educational Research Institute of British Columbia.
