Test equating is a statistical procedure to make scores from different test forms comparable and interchangeable. Focusing on an IRT approach, this paper proposes a novel method that simultaneously links the item parameter estimates of a large number of test forms. Our proposal differentiates itself from the current state of the art by using likelihood-based methods and by taking into account the heteroskedasticity and the correlation of the item parameter estimates of each form. Simulation studies show that our proposal yields equating coefficient estimates which are more efficient than what is currently available in the literature.
AitkenA. (1936). IV.—On least squares and linear combination of observations. Proceedings of the Royal Society of Edinburgh, 55(4), 42–48. https://doi.org/10.1017/S0370164600014346
BattauzM. (2019). On Wald tests for differential item functioning detection. Statistical Methods & Applications, 28(1), 103–118. https://doi.org/10.1007/s10260-018-00442-w
7.
BattauzM. (2021). EquateMultiple: Equating of multiple forms. R package version 0.1.0.
8.
BattauzM.BellioR. (2021). Shrinkage estimation of the three-parameter logistic model. British Journal of Mathematical and Statistical Psychology, 74(3), 591–609. https://doi.org/10.1111/bmsp.12241
9.
BockR. D.AitkinM. (1981). Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika, 46(4), 443–459. https://doi.org/10.1007/BF02293801
10.
ChalmersR. P. (2012). mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48(6), 1–29. https://doi.org/10.18637/jss.v048.i06
11.
DonoghueJ. R.IshamS. P. (1998). A comparison of procedures to detect item parameter drift. Applied Psychological Measurement, 22(1), 33–51. https://doi.org/10.1177/01466216980221002
HabermanS. J. (2009). Linking parameter estimates derived from an item-response model through separate calibrations (p. i–9). ETS Research Report Series. https://doi.org/10.1002/j.2333-8504.2009.tb02197.x
HaebaraT. (1980). Equating logistic ability scales by a weighted least squares method. Japanese Psychological Research, 22(3), 144–149. https://doi.org/10.4992/psycholres1954.22.144
16.
KimS-H.CohenA. S.KimH-O. (1994). An investigation of Lord’s procedure for the detection of differential item functioning. Applied Psychological Measurement, 18(3), 217–228. https://doi.org/10.1177/014662169401800303
KolenM. J.BrennanR. L. (2014). Test equating, scaling, and linking: Methods and practices (3rd ed.). New York: Springer.
19.
LiD.JiangY.von DavierA. A. (2012). The accuracy and consistency of a series of IRT true score equatings. Journal of Educational Measurement, 49(2), 167–189. https://doi.org/10.1111/j.1745-3984.2012.00167.x
LuR.HabermanS.GuoH.LiuJ. (2015). Use of jackknifing to evaluate effects of anchor item selection on equating with the nonequivalent groups with anchor test (neat) design. ETS Research Report Series, 2015(1), 1–12. https://doi.org/10.1002/ets2.12056
MichaelidesM. P.HaertelE. H. (2014). Selection of common items as an unrecognized source of variability in test equating: A bootstrap approximation assuming random sampling of common items. Applied Measurement in Education, 27(1), 46–57. https://doi.org/10.1080/08957347.2013.853069
OgasawaraH. (2001). Standard errors of item response theory equating/linking by response function methods. Applied Psychological Measurement, 25(1), 53–67. https://doi.org/10.1177/01466216010251004
26.
PorterJ. (2002). Efficiency of covariance matrix estimators for maximum likelihood estimation. Journal of Business & Economic Statistics, 20(3), 431–440. https://doi.org/10.1198/073500102288618559
27.
R Core Team (2021). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing.
28.
SeveriniT. A. (2000). Likelihood methods in statistics. Oxford University Press.
29.
StockingM. L.LordF. M. (1983). Developing a common metric in item response theory. Applied Psychological Measurement, 7(2), 201–210. https://doi.org/10.1177/014662168300700208
30.
von DavierA. A.HollandP. W.ThayerD. T. (2004). The kernel method of test equating. New York: Springer.
31.
WoodsC. M.CaiL.WangM. (2013). The Langer-improved Wald test for DIF testing with multiple groups: Evaluation and comparison to two-group IRT. Educational and Psychological Measurement, 73(3), 532–547. https://doi.org/10.1177/0013164412464875
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
