Asymptotic Standard Errors of Parameter Scale Transformation Coefficients in Test Equating Under the Nominal Response Model

Abstract

Researchers have developed a characteristic curve procedure to estimate the parameter scale transformation coefficients in test equating under the nominal response model. In the study, the delta method was applied to derive the standard error expressions for computing the standard errors for the estimates of the parameter scale transformation coefficients. This brief report presents the results of a simulation study that examined the accuracy of the derived formulas and compared the performance of this analytical method with that of the multiple imputation method. The results indicated that the standard errors produced by the delta method were very close to the criterion standard errors as well as those yielded by the multiple imputation method under all the simulation conditions.

Keywords

equating standard errors nominal response model delta method multiple imputation method

Get full access to this article

View all access options for this article.

References

American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. American Educational Research Association.

Andersson

(2018). Asymptotic variance of linking coefficient estimators for polytomous IRT models. Applied Psychological Measurement, 42(3), 192–205.

Baker

F. B.

(1993). Equating tests under the nominal response model. Applied Psychological Measurement, 17(3), 239–251.

Baker

F. B.

Kim

S. H.

(2004). Item response theory: Parameter estimation techniques. CRC Press.

Battauz

(2013). IRT test equating in complex linkage plans. Psychometrika, 78(3), 464–480.

Bock

R. D.

(1972). Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika, 37(1), 29–51.

Chalmers

R. P.

(2012). mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48(6), 1–29.

Chalmers

R. P.

(2018). Numerical approximation of the observed information matrix with Oakes’ identity. British Journal of Mathematical and Statistical Psychology, 71(3), 415–436.

Kim

J. S.

Hanson

B. A.

(2002). Test equating under the multiple-choice model. Applied Psychological Measurement, 26(3), 255–270.

10.

Kim

Lee

W. C.

(2006). An extension of four IRT linking methods for mixed-format tests. Journal of Educational Measurement, 43(1), 53–76.

11.

Kolen

M. J.

Brennan

R. L.

(2014). Test equating, scaling, and linking: methods and practices (3rd ed.). Springer Science & Business Media.

12.

Ogasawara

(2001). Standard errors of item response theory equating/linking by response function methods. Applied Psychological Measurement, 25(1), 53–67.

13.

Paek

Cai

(2014). A comparison of item parameter standard error estimation procedures for unidimensional and multidimensional item response theory modelling. Educational and Psychological Measurement, 74(1), 58–76.

14.

Preston

Reise

Cai

Hays

R. D.

(2011). Using the nominal response model to evaluate response category discrimination in the PROMIS emotional distress item pools. Educational and Psychological Measurement, 71(3), 523–550.

15.

Preston

K. S. J.

Parral

S. N.

Gottfried

A. W.

Oliver

P. H.

Gottfried

A. E.

Ibrahim

S. M.

Delany

(2015). Applying the nominal response model within a longitudinal framework to construct the Positive Family Relationships Scale. Educational and Psychological Measurement, 75(6), 901–930.

16.

Zhang

Z. H.

(2020a). Asymptotic standard errors of equating coefficients using the characteristic curve methods for the graded response model. Applied Measurement in Education. Advance online publication. https://doi.org/10.1080/08957347.2020.1789142

17.

Zhang

Z. H.

(2020b). Estimating standard errors of IRT true score equating coefficients using imputed item parameters. The Journal of Experimental Education. Advance online publication. https://doi.org/10.1080/00220973.2020.1751579

18.

Zhang

Z. H.

Zhao

(2019). Standard errors of IRT parameter scale transformation coefficients: Comparison of bootstrap method, delta method, and multiple imputation Method. Journal of Educational Measurement, 56(2), 302–330.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.21 MB