Empirical Sampling Distributions of Equating Coefficients for Graded and Nominal Response Instruments

Abstract

The sampling distributions of equating coefficients produced by the characteristic curve method for tests using graded and nominal response scoring were examined. Simulated data were generated under these two models in both horizontal and vertical equating situations for three different types of target tests. The obtained sampling distributions of the equating coefficients were approximately bell-shaped, had small variances, and no outliers or other abnormalities. However, the distributions of the minimum values of the quadratic loss function for the graded response model had outliers that were due to misordered boundary curve location parameter estimates. The means of the sampling distributions of the equating coefficients corresponded to values appropriate for the specific situations used.

Get full access to this article

View all access options for this article.

References

Baker, F. B. (1986). GENIRV: Computer program for generating item responses. Unpublished manuscript, University of Wisconsin, Educational Psychology, Madison.

Baker, F. B. (1992). Equating tests under the graded response model. Applied Psychological Measurement, 16, 87-96.

Baker, F. B. (1993a). EQUATE 2.0: A computerprogram for the characteristic curve method of IRT equating. Applied Psychological Measurement, 17, 20-20.

Baker, F. B. (1993b). Equating tests under the nominal response model. Applied Psychological Measurement, 17, 239-251.

Baker, F. B. (1996). An investigation of the sampling distributions of equating coefficients. Applied Psychological Measurement, 20, 45-57.

Bock, R. D. (1972). Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika, 37, 29-51.

Davidon, W. C. (1959). Variable metric method for minimization (Research and Development Report ANL-5990, rev. ed.). Argonne IL: Argonne National Laboratory, U.S. Atomic Energy Commission.

Fletcher, R. , & Powell, M. J. D. (1963). A rapidly convergent decent method for minimization. The Computer Journal, 6, 163-168.

Haebara, T. (1980). Equating logistic ability scales by a weighted least squares method. Japanese Psychological Research, 22, 144-149.

10.

Hulin, C. L. , Lissak, R. I. , & Drasgow, F. (1982). Recovery of twoand three-parameter logistic item characteristic curves: A monte carlo study. Applied Psychological Measurement, 6, 249-260.

11.

Press, W. H. , Flannery, B. P. , Teukolsky, S. A. , & Vetterling, W. T. (1986). Numerical recipes. Cambridge, England: Cambridge University Press.

12.

Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement, No. 17.

13.

Stocking, M. L. , & Lord, F. M. (1983). Developing a common metric in item response theory. Applied Psychological Measurement, 7, 201-210.

14.

Swaminathan, H. , & Gifford, J. A. (1983). Estimation of parameters in the three-parameter latent trait model. In D. J. Weiss (Ed.), New horizons in testing: Latent trait test theory and computerized adaptive testing (pp. 13-30). New York: Academic Press.

15.

Thissen, D. (1991). MULTILOG users guide (Ver. 6.0). Chicago: Scientific Software.

16.

Yen, W. M. (1981). Using simulation results to choose a latent trait model. Applied Psychological Measurement, 5, 245-262.

17.

Yen, W. M. (1987). A comparison of the efficiency and accuracy of BILOG and LOGIST. Psychometrika, 52, 275-291.