An Application of Computer Adaptive Testing with Communication Handicapped Examinees

Abstract

This study was conducted to evaluate a computerized adaptive testing procedure for the measurement of mathematical skills of entry level deaf college students. The theoretical basis of the study was the Rasch model for person measurement. Sixty persons were tested using an Apple II Plus microcomputer. Ability estimates provided by the computerized procedure were compared for stability with those obtained six to eight weeks earlier from conventional (written) testing of the same subject matter. Students' attitudes toward their testing experiences also were measured. Substantial increases in measurement efficiency (by reducing test length) were realized through the adaptive testing procedure. Because the item pool used was not specifically designed for adaptive testing purposes, the psychometric quality of measurements resulting from the different testing methods was approximately equal. Attitudes toward computerized testing were favorable.

Get full access to this article

View all access options for this article.

References

Bejar, I. I. (1983). Achievement testing: Recent advances. Sage University Paper Series (No. 36) on Quantitative Applications in the Social Sciences. Beverly Hills: Sage Publications.

Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee's ability. In Lord, F. M. and Novick, M. R., Statistical theories of mental test scores (pp. 397-479). Reading, MA: Addison-Wesley.

California Achievement Tests, Forms C and D. CTB/McGraw-Hill, Monterey, CA.

Comprehensive Tests of Basic Skills, Forms U and V. CTB/McGraw-Hill, Monterey, CA.

Iowa Tests of Basic Skills, Forms 7 and 8. Riverside Publishing Company, Chicago, IL.

Lord, F. M. (1970). Some test theory for tailored testing. In W. H. Holtzman (Ed.), Computer assisted instruction, testing, and guidance (pp. 139-183). New York: Harper & Row.

Lord, F. M. (1977). A broad-range tailored test of verbal ability. Applied Psychological Measurement, 1(1), 95-100. (a)

Lord, F. M. (1977). Practical applications of item characteristic curve theory. Journal of Educational Measurement, 14(2), 117-138. (b)

Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Lawrence Erlbaum.

10.

McKinley, R. L. and Reckase, M. D. (1980). A successful application of latent trait theory to tailored achievement testing. (Research Report 80-1). Columbia, MO: University of Missouri, Educational Psychology Department, Tailored Testing Research Laboratory.

11.

Patience, W. M. (1977). Description of components in tailored testing. Behavior Research Methods and Instrumentation, 9(2), 153-157.

12.

Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen: Danmarks Paedagogiske Institut.

13.

Reckase, M. D. (1974). An interactive computer program for tailored testing based on the one-parameter logistic model. Behavior Research Methods and Instrumentation, 6(2), 208-212.

14.

SRA Achievement Tests, Forms 1 and 2. Science Research Associates, Chicago, IL.

15.

Stanford Achievement Series, Forms E and F. The Psychological Corporation, Cleveland, OH.

16.

Taylor, R. W. W. (1979). MSP: The math skills project at the National Technical Institute for the Deaf. (Report No. 20). Rochester, NY: National Technical Institute for the Deaf, Technical Mathematics Department.

17.

Weiss, D. J. (1973). The stratified adaptive computerized ability test. (Research Report 73-3). Minneapolis: University of Minnesota, Department of Psychology.

18.

Weiss, D. J. (1982). Improving measurement quality and efficiency with adaptive testing. Applied Psychological Measurement, 6(4), 473-492.

19.

Wright, B. D. , Mead, R. J. , and Bell, S. R. (1980). BICAL: Calibrating items with the Rasch model. (Research Memorandum No. 23C). Chicago: University of Chicago, Department of Education, Statistical Laboratory.

20.

Wright, B. D. and Stone, M. H. (1979). Best test design: Rasch measurement. Chicago: Mesa Press.