In educational and psychological research, the logit and probit links are often used to fit the binary item response data. The appropriateness and importance of the choice of links within the item response theory (IRT) framework has not been investigated yet. In this paper, we present a family of IRT models with generalized logit links, which include the traditional logistic and normal ogive models as special cases. This family of models are flexible enough not only to adjust the item characteristic curve tail probability by two shape parameters but also to allow us to fit the same link or different links to different items within the IRT model framework. In addition, the proposed models are implemented in the Stan software to sample from the posterior distributions. Using readily available Stan outputs, the four Bayesian model selection criteria are computed for guiding the choice of the links within the IRT model framework. Extensive simulation studies are conducted to examine the empirical performance of the proposed models and the model fittings in terms of “in-sample” and “out-of-sample” predictions based on the deviance. Finally, a detailed analysis of the real reading assessment data is carried out to illustrate the proposed methodology.
Aranda-OrdazF. J. (1981). On two families of transformations to additivity for binary response data. Biometrika, 68(2), 357–363. https://doi.org/10.1093/biomet/68.2.357
BirnbaumA. (1957). Efficient design and use of tests ofa mental ability for various decision-making problems. Series Report No. 58-16. Randolph air force base. USAF School of Aviation Medicine.
5.
BirnbaumA. (1968). Some latent trait models and their use in inferring an examinee’s ability. In LordF. M.NovickM. R. (Eds.), Statistical theories of mental test scores (pp. 397–479). MIT Press.
6.
BrooksS. P.GelmanA. (1998). General methods for monitoring convergence of iterative simulations. Journal of Computational and Graphical Statistics, 7(4), 434–455. https://doi.org/10.1080/10618600.1998.10474787
7.
ChenM.-H.DeyD. K.ShaoQ.-M. (1999). A new skewed link model for dichotomous quantal response data. Journal of the American Statistical Association, 94(448), 1172–1186. https://doi.org/10.1080/01621459.1999.10473872
8.
ChenM.-H.DeyD. K.WuY. (2002). On robustness of choice of links in binomial regression. Calcutta Statistical Association Bulletin, 53(1–2), 145–164. https://doi.org/10.1177/0008068320020113
9.
ChenM.-H.IbrahimJ. G.ShaoQ.-M. (2000). Monte Carlo methods in Bayesian computation. Springer.
10.
CzadoC.SantnerT. J. (1992). The effect of link misspecification on binary regression inference. Journal of Statistical Planning and Inference, 33(2), 213–231. https://doi.org/10.1016/0378-3758(92)90069-5
11.
EmbretsonS. E.ReiseS. P. (2000). Item response theory for psychologists. Erlbaum.
GelfandA. E.DeyD. K.ChangH. (1992). Model determinating using predictive distributions with implementation via sampling-based methods (with Discussion). In BernadoJ.M.BergerJ.O.DawidA.P.SmithA.F.M. (Eds.), Bayesian statistics 4 (pp. 147–167). Oxford University Press.
15.
GelmanA.RubinD. B. (1992). Inference from iterative simulation using multiple sequences. Statistical Science, 7(4), 457–472. https://doi.org/10.1214/ss/1177011136
16.
GemanS.GemanD. (1984). Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6(6), 721–741. https://doi.org/10.1109/tpami.1984.4767596
GuerreroV. M.JohnsonR. A. (1982). Use of the Box-Cox transformation with binary response models. Biometrika, 69(2), 309–314. https://doi.org/10.1093/biomet/69.2.309
19.
HadfieldJ. D. (2010). MCMC methods for multi-response generalized linear mixed models: The MCMCglmm R package. Journal of Statistical Software, 33(2), 1–22. http://www.jstatsoft.org/v33/i02/.
20.
HockemeyerC. (2002). A comparison of non-deterministic procedures for the adaptive assessment of knowledge. Psychologische Beitrage, 44(4), 495–503.
JiangX.DeyD. K.PrunierR.WilsonA. M.HolsingerK. E. (2014). A new class of flexible link functions with application to species co-occurrence in Cape floristic region. The Annals of Applied Statistics, 7(4), 2180–2204. https://doi.org/10.1214/13-AOAS663
23.
KimS.ChenM.-H.DeyD. K. (2008). Flexible generalized t-link models for binary response data. Biometrika, 95(1), 93–106. https://doi.org/10.1093/biomet/asm079.
24.
LokenE.RulisonK. L. (2010). Estimation of a four-parameter item response theory model. British Journal of Mathematical and Statistical Psychology, 63(3), 509–525. https://doi.org/10.1348/000711009X474502
25.
LordF. M. (1952). A theory of mental test scores. In Psychometric monograph (No.7). Psychometric Society.
26.
LordF. M.NovickM. R. (1968). Statistical theories of mental test scores. Addison-Wesley.
27.
LunnD. J.ThomasA.BestN.SpiegelhalterD. (2000). WinBUGS–a Bayesian modelling framework: Concepts, structure, and extensibility. Statistics and Computing, 10(4), 325–337. https://doi.org/10.1023/a:1008929526011
28.
LuoY.JiaoH. (2017). Using the Stan program for Bayesian item response theory. Educational and Psychological Measurement, 78(3), 384–408. https://doi.org/10.1177/0013164417693666
29.
MartinA. D.QuinnK. M.ParkJ. H. (2011). Mcmcpack: Markov chain monte carlo in R. Journal of Statistical Software, 42(9), 1–21. https://doi.org/10.18637/jss.v042.i09
30.
MetropolisN.RosenbluthA. W.RosenbluthM. N.TellerA. H.TellerE. (1953). Equation of state calculations by fast computing machines. Journal of Chemical Physics, 21(6), 1087–1092. https://doi.org/10.1063/1.1699114
NealR. M. (2011). MCMC using Hamiltonian dynamics. In BrooksS.GelmanA.MengX.-L. (Eds.), Handbook of Markov chain Monte Carlo 2 (pp. 113–162). Chapman & Hall/CRC Press. https://doi.org/10.1201/b10905-6
RaschG. (1960). Probabilistic models for some intelligence and attainment tests.Danish Institute for Educational Research.
35.
RoyV.DeyD. K. (2014). Propriety of posterior distribution arising in categorical and survival models under generalized extreme value distribution. Statistica Sinica, 24(2), 699–722. https://doi.org/10.5705/ss.2012.011
36.
RulisonK. L.LokenE. (2009). I’ve fallen and I can’t get up: Can high-ability students recover from early mistakes in CAT?. Applied Psychological Measurement, 33(2), 83–101. https://doi.org/10.1177/0146621608324023
SpiegelhalterD. J.BestN. G.CarlinB. P.Van Der LindeA. (2002). Bayesian measures of model complexity and fit. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 64(4), 583–639. https://doi.org/10.1111/1467-9868.00353
TaoJ.ShiN.-Z.ChangH.-H. (2012). Item-weighted likelihood method for ability estimation in tests composed of both dichotomous and polytomous items. Journal of Educational and Behavioral Statistics, 37(2), 298–315. https://doi.org/10.3102/1076998610393969
43.
Van der LindenW. J.HambletonR. K. (Eds.). (1997). Handbook of modern item response theory. Springer.
44.
VehtariA.GelmanA.GabryJ. (2017). Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC. Statistics and Computing, 27(5), 1413–1432. https://doi.org/10.1007/s11222-016-9696-4
45.
WangX.DeyD. K. (2010). Generalized extreme value regression for binary response data: An application to B2B electronic payments system adoption. The Annals of Applied Statistics, 4(4), 2000–2023. https://doi.org/10.1214/10-aoas354
46.
WangX.DeyD. K. (2011). Generalized extreme value regression for ordinal response data. Environmental and Ecological Statistics, 18(4), 619–634. https://doi.org/10.1007/s10651-010-0154-8
47.
WatanabeS. (2010). Asymptotic equivalence of Bayes cross validation and widely applicable information criterion in singular learning theory. Journal of Machine Learning Research, 11, 3571–3594. https://doi.org/10.48550/arXiv.1004.2316
48.
WhittmoreA. S. (1983). Transformations to linearity in binary regression. SIAM Journal on Applied Mathematics, 43(4), 703–710. https://doi.org/10.1137/0143048
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
