In their 2005 paper, Li and her colleagues proposed a test response function (TRF) linking method for a two-parameter testlet model and used a genetic algorithm to find minimization solutions for the linking coefficients. In the present paper the linking task for a three-parameter testlet model is formulated from the perspective of bi-factor modeling, and three linking methods for the model are presented: the TRF, mean/least squares (MLS), and item response function (IRF) methods. Simulations are conducted to compare the TRF method using a genetic algorithm with the TRF and IRF methods using a quasi-Newton algorithm and the MLS method. The results indicate that the IRF, MLS, and TRF methods perform very well, well, and poorly, respectively, in estimating the linking coefficients associated with testlet effects, that the use of genetic algorithms offers little improvement to the TRF method, and that the minimization function for the TRF method is not as well-structured as that for the IRF method.
BockR. D.ZimowskiM. F. (1997). Multiple group IRT. In van der LindenW. J.HambletonR. K. (Eds.), Handbook of modern item response theory (pp. 433–448). Springer. https://doi/org/10.1007/978-1-4757-2691-6_25
2.
BradlowE. T.WainerH.WangX. (1999). A Bayesian random effects model for testlets. Psychometrika, 64(2), 153–168. https://doi.org/10.1007/bf02294533
3.
CaiL. (2017). flexMIRT: Flexible multilevel multidimensional item analysis and test scoring [Computer software]. Vector Psychometric Group.
DeMarsC. E. (2006). Application of the bi-factor multidimensional item response theory model to testlet-based tests. Journal of Educational Measurement, 43(2), 145-168. https://doi.org/10.1111/j.1745-3984.2006.00010.x
6.
DennisJ. E.SchnabelR. B. (1996). Numerical methods for unconstrained optimization and nonlinear equations. Society for Industrial and Applied Mathematics.
7.
DivgiD. R. (1985). A minimum chi-square method for developing a common metric in item response theory. Applied Psychological Measurement, 9(4), 413–415. https://doi.org/10.1177/014662168500900410
GlasC. A. W.WainerH.BradlowE. T. (2000). Maximum marginal likelihood and expected a posteriori estimation in testlet-based adaptive testing. In van der LindenW. J.GlasC. A. W. (Eds.), Computerized adaptive testing: Theory and practice (pp. 271–287). Kluwer Academic Publishers. https://doi.org/10.1007/0-306-47531-6_14
10.
HaebaraT. (1980). Equating logistic ability scales by a weighted least squares method. Japanese Psychological Research, 22(3), 144–149. https://doi.org/10.4992/psycholres1954.22.144
KimS. (2019). Common-item linking methods for the bi-factor three parameter model in MIRT. Journal of Educational Evaluation, 32(1), 27–52. https://doi.org/10.31158/jeev.2019.32.1.27
KolenM. J.BrennanR. L. (2014). Test equating, scaling, and linking: Methods and practices (3rd ed.). Springer.
15.
LiY.BoltD. M.FuJ. (2005). A testlet characteristic curve linking method for the testlet model. Applied Psychological Measurement, 29(5), 340–356. https://doi.org/10.1177/0146621605276678
16.
LiY.BoltD. M.FuJ. (2006). A comparison of alternative models for testlets. Applied Psychological Measurement, 30(1), 3–21. https://doi.org/10.1177/0146621605275414
17.
LordF. M. (1980). Applications of item response theory to practical testing problems. Lawrence Erlbaum Associates.
MebaneW. R.SekhonJ. S. (2011). Genetic optimization using derivatives: The rgenoud package for R. Journal of Statistical Software, 42(11), 1–26. https://doi.org/10.18637/jss.v042.i11
R Development Core Team (2018). R: A language and environment for statistical computing. R Foundation for Statistical Computing.
23.
RijmenF. (2010). Formal relations and an empirical comparison among the bi-factor, the testlet, and a second-order multidimensional IRT model. Journal of Educational Measurement, 47(3), 361–372. https://doi.org/10.1111/j.1745-3984.2010.00118.x
StockingM. L.LordF. M. (1983). Developing a common metric in item response theory. Applied Psychological Measurement, 7(2), 201–210. https://doi.org/10.1177/014662168300700208
26.
WainerH.BradlowE. T.WangX. (2007). Testlet response theory and its applications. Cambridge University Press.
YenW. M.FitzpatrickA. R. (2006). Item response theory. In BrennanR. L. (Ed.), Educational measurement (4th ed., pp. 111–153). American Council on Education and Praeger.
