Use of computerized adaptive testing (CAT) has increased substantially since it was first formulated in the 1970s. This paper provides an overview of CAT and introduces the contributions to this Special Issue. The elements of CAT discussed here include item selection procedures, estimation of the latent trait, item exposure, measurement precision, and item bank development. Some topics for future research are also presented.
Get full access to this article
View all access options for this article.
References
1.
College Board (1993). User’s notebook. New York: Author.
2.
Davey, T. , Godwin, J., & Mittelholz, D. (1997). Developing and scoring an innovative computerized writing assessment. Journal of Educational Measurement, 34, 21–41.
3.
Davey, T. , & Nering, M. L. (1998, September). Controlling item exposure and maintaining item security. Paper presented at the ETS-sponsored colloquium entitled Computer-based testing: Building the foundations for future assessments, Philadelphia PA.
4.
Dodd, B. G. , De Ayala, R. J., & Koch, W. R. (1995). Computerized adaptive testing with polytomous items. Applied Psychological Measurement, 19, 5–22.
5.
Dodd, B. G. , & Fitzpatrick, S. J. (1998, September). Alternatives for scoring computerized adaptive tests. Paper presented at the ETS-sponsored colloquium entitled Computer-based testing: Building the foundations for future assessments, Philadelphia PA.
6.
Drasgow, F. , & Olson-Buchanan, J. B. (Eds.). (1999). Innovations in computerized assessment. Hillsdale NJ: Erlbaum.
7.
Educational Testing Service (1996). Graduate Record Examinations 1996-1997: Information and registration bulletin. Princeton NJ: Author.
8.
Glas, C. A. W. , & Veerkamp, W. J. J. (in press). Item calibration and parameter drift. In W. J. van der Linden & C. A. W. Glas (Eds.), Computer adaptive testing: Theory and practice. Boston: Kluwer Academic.
9.
Hambleton, R. K. , & Swaminathan, H. (1985). Item response theory: Principles and applications. Boston: Kluwer-Nijhoff.
10.
Lord, F. M. (1971). A theoretical study of two-stage testing. Psychometrika, 36, 227–242.
11.
Lord, F. M. (1977). Abroad-range tailored test of verbal ability. Applied Psychological Measurement, 1, 95–100.
12.
Lord, F. M. (1983). Unbiased estimators of ability parameters, of their variance, and their parallel forms reliability. Psychometrika, 48, 233–245.
13.
McLeod, L. D. , & Lewis, C. (1999). Detecting item memorization in the CAT environment. Applied Psychological Measurement, 23, 147–160.
14.
Meijer, R. R. , Sijtsma, K., & Molenaar, I. W. (1995). Reliability estimation for single dichotomous items based on Mokken’s IRT model. Applied Psychological Measurement, 19, 323–335.
15.
Mokken, R. J. (1997). Nonparametric models for dichotomous responses. In W. J. van der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory(pp. 351–367). New York: Springer.
16.
Moreno, K. E. , & Segall, O. D. (1997). Reliability and construct validity of CAT-ASVAB. In W. A. Sands, B. K. Waters, & J. R. McBride (Eds.). Computerized adaptive testing: From inquiry to operation(pp. 169–179). Washington DC: American Psychological Association.
17.
Nering, M. L. (1997). The distribution of indexes of person misfit within the computerized adaptive environment. Applied Psychological Measurement, 21, 115–127.
18.
Owen, R. J. (1975). A Bayesian sequential procedure for quantal response in the context of adaptive mental testing. Journal of the American Statistical Association, 70, 351–356.
19.
Parshall, C. G. , Davey, T., & Pashley, P. (in press). Innovative item types for computerized testing. In W. J. van der Linden & C. A. W. Glas (Eds.), Computer adaptive testing: Theory and practice. Boston: Kluwer Academic.
20.
Sands, W. A. , Waters, B. K., & McBride, J. R. (Eds.) (1997). Computerized adaptive testing: From inquiry to operation. Washington DC: American Psychological Association.
21.
Schnipke, D. L. , & Green, B. F. (1995). A comparison of item selection routines in linear and adaptive tests. Journal of Educational Measurement, 32, 227–242.
22.
Segall, D. O. (1996). Multidimensional adaptive testing. Psychometrika, 61, 331–354.
23.
Segall, D. O. , & Moreno, K. E. (1997). Current and future challenges. In W. A. Sands, B. K. Waters, & J. R. McBride (Eds.). Computerized adaptive testing: From inquiry to operation (pp. 257–269). Washington DC: American Psychological Association.
24.
Sijtsma, K. , & Molenaar, I. W. (1987). Reliability of test scores in nonparametric item response theory. Psychometrika, 52, 79–97.
25.
Stocking, M. L. , & Swanson, L. (1993). A method for severely constrained item selection in adaptive testing. Applied Psychological Measurement, 17, 277–292.
26.
Swanson, L. , & Stocking, M. L. (1993). A model and heuristic for solving very large item selection problems. Applied Psychological Measurement, 22, 271–280.
27.
Stocking, M. L. , Ward, W. C., & Potenza, M. T. (1998). Simulating the use of disclosed items in computerized adaptive testing. Journal of Educational Measurement, 17, 151–166.
28.
Sympson, J. B. , & Hetter, R. D. (1985). Controlling item exposure rates in computerized adaptive test-ing. Proceedings of the 27th annual meeting of the Military Testing Association, 973–977.
29.
Thissen, D. (1990). Reliability and measurement precision. In H. Wainer, N. J. Dorans, R. Flaugher, B. F. Green, R. J. Mislevy, L. Steinberg,& D. Thissen (Eds.), Computerized adaptive testing: A primer(pp. 161–186). Hillsdale NJ: Erlbaum.
30.
Thissen, D. , & Mislevy, R. J. (1990). Testing algorithms. In H. Wainer, N. J. Dorans, R. Flaugher, B. F. Green, R. J. Mislevy, L. Steinberg,& D. Thissen (Eds.), Computerized adaptive testing: A primer(pp. 103–134). Hillsdale NJ: Erlbaum.
31.
van der Linden, W. J. (1998a). Bayesian item selection criteria for adaptive testing. Psychometrika, 63, 201–216.
32.
van der Linden, W. J. (1998b). Optimal assembly of psychological and educational tests. Applied Psychological Measurement, 22, 195–211.
33.
van der Linden, W. J. , & Glas, C. A. W. (Eds.). (in press). Computer adaptive testing: Theory and practice. Boston: Kluwer Academic.
34.
van Krimpen-Stoop, E. M. L. A. , & Meijer, R. R. (in press). Detecting person-misfit in adaptive testing using statistical process control techniques. In W. J. van der Linden & C. A. W. Glas (Eds.), Computer adaptive testing: Theory and practice. Boston: Kluwer Academic.
35.
Veerkamp, W. J. J. (1997). Statistical methods for computerized adaptive testing. Unpublished doctoral dissertation, University of Twente, Enschede, The Netherlands.
36.
Veerkamp, W. J. J. , & Berger, M. P. F. (1997). Some new item selection criteria for adaptive testing. Journal of Educational and Behavioral Statistics, 22, 203–226.
37.
Veldkamp, B. P. , & van der Linden, W. J. (in press). Item pool design for CAT. In W. J. van der Linden & C. A. W. Glas (Eds.), Computer adaptive testing: Theory and practice. Boston: Kluwer Academic.
38.
Verschoor, A. , & Straetmans, G. (in press). Math CAT: A flexible testing system for adult mathematics education. In W. J. van der Linden & C. A. W. Glas (Eds.), Computer adaptive testing: Theory and practice. Boston: Kluwer Academic.
39.
Wainer, H. , Dorans, N. J., Flaugher, R., Green, B. F., Mislevy, R. J., Steinberg, L., & Thissen, D. (Eds.) (1990). Computerized adaptive testing: A primer. Hillsdale NJ: Erlbaum.
40.
Warm, T. A. (1989). Weighted likelihood estimation of ability in item response theory. Psychometrika, 54, 427–450.
41.
Weiss, D. J. (1982). Improving measurement quality and efficiency with adaptive testing. Applied Psychological Measurement, 4, 273–285.
42.
Weiss, D. J. (Ed.). (1983). New horizons in testing: Latent trait test theory and computerized adaptive testing. New York: Academic Press.
43.
Zwick, R. (1997). The effect of adaptive administration on the variability of the Mantel-Haenszel measure of differential item functioning. Educational and Psychological Measurement, 57, 412–421.
