Sage Journals: Discover world-class research

Abstract

This study compared the fit of the three-parameter model to that of the Ability Removing Random Guessing (ARRG) model (Waller, 1973) on data from a wide range of tests of cognitive ability in three repre sentative samples. Although both models were de signed to remove only the effects of random guessing, the results of this study indicated that the three-param eter model also makes an adjustment for partial- knowledge guessing. Fit of the three-parameter model with guessing parameters estimated at a constant value of 1 divided by the number of alternatives was com pared to fit with individually estimated guessing pa rameters. The latter were found to produce fit far su perior to those estimated at a constant value. A solution to the convergence problems often encoun tered with the three-parameter model is discussed.

Keywords

Index terms: Ability Removing Random Guessing model convergence in three-parameter estimation procedures item response theory maximum likelihood estimation partial-knowledge guessing random guessing.

Get full access to this article

View all access options for this article.

References

Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee's ability. In F. M. Lord & M. R. Novick , Statistical theories of mental test scores. Reading MA: Addison-Wesley.

Bock, R.D. (1972). Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika, 37, 29-51.

Bock, R.D. , & Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika , 46, 443-459.

Choppin, B.H.L. (1985). A two-parameter latent trait model. Evaluation in Education, 9, 43-62.

CTB McGraw-Hill. (1974). Comprehensive Tests of Basic Skills. Monterey CA: Author.

Feller, W. (1968). An introduction to probability theory and its applications, volume 1. New York: Wiley.

Kolakowski, D. , & Bock, R.D. (1973). LOGOG: Maximum likelihood item analysis and test scoring: Logistic model for multiple item responses. Ann Arbor MI: National Educational Resources.

Samejima, F. (1973). A comment on Birnbaum's three-parameter model in the latent trait theory. Psychometrika, 38, 221-233.

Waller, M.I. (1973). Removing the effects of random guessing from latent trait ability estimates. Unpublished doctoral dissertation, University of Chicago.

10.

Waller, M.I. (1976). Estimating parameters in the Rasch model: Removing the effects of random guessing (Research Bulletin RB-76-8. Princeton NJ: Educational Testing Service.

11.

Yen, W.M. (1981). Using simulation results to choose a latent trait model. Applied Psychological Measurement, 5, 245-262.

Modeling Guessing Behavior: A Comparison of Two IRT Models

Abstract

Keywords

Get full access to this article

References