This study, using Spanish high school students, compared four types of a computer-based English vocabulary test: (a) a self-adapted test (SAT), (b) a computerized adaptive test (CAT), (c) a conventional test of randomly selected items, and (d) a test that combined SAT and CAT (SCAT). No statistically significant differences were found among the test types for either estimated ability or posttest anxiety. Statistically significant differences were found for the number of correct responses (co = .091) and testing time (Co2 = .023). The results suggest caution in generalizations made by researchers and practitioners regarding the effects of SAT on examinees.
Get full access to this article
View all access options for this article.
References
1.
Assessments Systems Corporation. (1988). User's manual for the Micro CAT testing system Version 3. St. Paul, MN: Author.
2.
Hambleton, R. K. (1989). Principles and selected applications of item response theory. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 147-200). New York: Macmillan.
3.
Hembree, R. (1988). Correlates, causes, effects, and treatment of test anxiety. Review of Educational Research, 58, 47-77.
4.
Johnson, P. L. , Roos, L. L., Wise, S. L., & Plake, B. S. (1991). Correlates of examinee item choice behavior in self-adapted testing. Mid-Western Educational Researcher, 4(3), 25-28.
5.
Ponsoda, V. , Olea, J., & Revuelta, J. (1994). ADTEST: A computer-adaptive test based on the maximuminformationprinciple.EducationalandPsychologicalMeasurement, 54, 680-686.
6.
Rocklin, T. R. (1994). Self-adapted testing. Applied Measurement in Education, 7, 3-14.
7.
Rocklin, T. R. , & O'Donnell, A. M. (1987). Self-adapted testing: A performance-improving variant of computerized adaptive testing. Journal of Educational Psychology, 79, 315-319.
8.
Rocklin, T. R. , & O'Donnell, A. M. (1991, April). An empirical comparison of self adapted and maximum information item selection. Paperpresented at the annual meeting of the American Educational Research Association, Chicago.
9.
Roos, L L. , Plake, B. S., & Wise, S. L. (1992, April). The effects of feedback in computerized adaptive and self-adapted tests. Paper presented at the annual meeting of the National Council on Measurement in Education, San Francisco.
10.
Spielberger, C. D. , Gorsuch, R. L., & Lushene, R. E. (1970). Manual for the State-Trait Anxiety Inventory. Palo Alto, CA: Consulting Psychologists Press. (Spanish adaptation by TEA Ediciones SA [1988, 3rd ed.])
11.
Vimrella, B. , Arbona, C., & Novy, D. M. (1994). Psychometric properties and factor structure of the Spanish version of the State-Trait Anxiety Inventory. Journal of Personality Assessment, 63, 401-412.
12.
Vispoel, W. P. , & Coffman, D. D. (1994). Computer-adaptive and self-adaptive music listening tests: Psychometric features and motivational benefits. Applied Measurement in Education, 7, 25-51.
13.
Vispoel, W. P. , Rocklin, T., & Wang, T. (1994). Individual differences and test administration procedures: A comparison of fixed-item, computer-adaptive, and self-adaptive testing. Applied Measurement in Education, 7, 53-79.
14.
Vispoel, W. P. , Wang, T., de la Torre, R., Bleiler, T., & Dings, J. (1992, April). How review options and administration modes influence scores on computerized vocabulary tests. Paper presented at the annual meeting of the American Educational Research Association, San Francisco.
15.
Wise, S. L. (1994). Understanding self-adapted testing: The perceived control hypothesis. Applied Measurement in Education, 7, 15-24.
16.
Wise, S. L. , Plake, B. S., Johnson, P. L., & Roos, L. L. (1992). A comparison of self-adapted and computerized adaptive tests. Journal of Educational Measurement, 29, 329-339.
