This article proposes an item response model that incorporates response time. A parameter estimation procedure using the EM algorithm is developed. The procedure is evaluated with both real and simulated test data. The results suggest that the estimation procedure works well in estimating model parameters. By using response time data, estimation of person ability parameters can be improved. Potential applications of this model are discussed. Directions for further study are suggested.
Hopkins, K. D. (1998). Educational and psychological measurement and evaluation. Needham Heights, MA: Allyn & Bacon.
2.
Jansen, M. G. H. (1997). Rasch’s model for reading speed with manifest explanatory variables. Psychomtrika, 62, 393-409.
3.
Luce, R. D. (1986). Response times: Their role in inferring elementary mental organization. New York: Oxford University Press.
4.
Mislevy, R. J., & Bock, R. J. (1990). BILOG3: Item analysis and test scoring with binary logistic model (2nd ed.) [Computer program]. Mooresville, IN: Scientific Software.
5.
Parshall C. G., Mittelholtz, D., & Miller, T. R. (1994, April). Response time: An investigation into determinants of item-level timing. Paper presented at the meeting of the National Council on Measurement in Education, New Orleans, LA.
6.
Roskam, E. E. (1997). Models for speed and time-limit tests. In W. J. van der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory (pp. 187-208). New York: Springer.
7.
Schnipke, D. L., & Scrams, D. J. (1997). Modeling item response times with a two-state mixture model: A new method of measuring speededness. Journal of Educational Measurement, 34, 213-232.
8.
Schnipke, D. L., & Scrams, D. J. (1998, September). Exploring issues of examinee behavior: Insights gained from response-time analyses. Paper presented at the ETS colloquium on “Computer Based Testing: Building the Foundation for Future Assessment,”Philadelphia.
9.
Scrams, D. J., & Schnipke, D. L. (1997, March). Making use of response times in standardized tests: Are accuracy and speed measuring the same thing? Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago.
10.
Segall, D. O. (1987). Relation between estimated ability and test time on the CAT-ASVAB. Unpublished manuscript.
11.
Swygert, K. A. (1998). An examination of item response times on the GRE-CAT. Unpublished doctoral dissertation, University of North Carolina, Chapel Hill.
12.
Thissen, D. (1983). Timed testing: An approach using item response theory. In D. J. Weiss (Ed.), New horizons in testing: Latent trait test theory and computerized adaptive testing (pp. 179-203). New York: Academic Press.
13.
Verhelst, N. D., Verstralen, H. H. F. M., & Jansen, M. G. H. (1997). A logistic model for time-limit tests. In W. J. van der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory (pp. 169-185). New York: Springer.
14.
Woodruff, D. J., & Hanson, B. A. (1996). Estimation of item response models using the EM algorithm for finite mixture (ACT Research Rep. 96-6). Iowa City, IA: ACT, Inc.