A modified and improved inductive inferential approach to evaluate item discriminations in a conditional maximum likelihood and Rasch modeling framework is suggested. The new approach involves the derivation of four hypothesis tests. It implies a linear restriction of the assumed set of probability distributions in the classical approach that represents scenarios of different item discriminations in a straightforward and efficient manner. Its improvement is discussed, compared to classical procedures (tests and information criteria), and illustrated in Monte Carlo experiments as well as real data examples from educational research. The results show an improvement of power of the modified tests of up to 0.3.
AkaikeH. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19(6), 716–723. https://doi.org/10.1109/TAC.1974.1100705
2.
AndersenE. B. (1970). Asymptotic properties of conditional maximum-likelihood estimators. Journal of the Royal Statistical Society. Series B (Methodological), 32(2), 283–301. https://doi.org/10.1111/j.2517-6161.1970.tb00842.x
BirnbaumA. (1968). Some latent trait models and their use in inferring an examinee’s ability. In LordF. M.NovickM. R. (Eds.), Statistical theories of mental test scores (pp. 397–424). Addison Wesley.
DraxlerC.AlexandrowiczR. W. (2015). Sample size determination within the scope of conditional maximum likelihood estimation with special focus on testing the Rasch model. Psychometrika, 80(4), 897–919. https://doi.org/10.1007/s11336-015-9472-y
7.
DraxlerC.DahmS. (2020). Conditional or pseudo exact tests with an application in the context of modeling response times. Psych, 2(4), 198–208. https://doi.org/10.3390/psych2040017
8.
DraxlerC.KurzA. (2021). Conditional inference in small sample scenarios using a resampling approach. Stats, 4(4), 837–849. https://doi.org/10.3390/stats4040049
DraxlerC.KurzA.LemonteA. J. (2022). The gradient test and its finite sample size properties in a conditional maximum likelihood and psychometric modeling context. Communications in Statistics—Simulation and Computation, 51(6), 3185–3203. https://doi.org/10.1080/03610918.2019.1710193
11.
DraxlerC.NolteJ. P. (2018). Computational precision of the power function for conditional tests of assumptions of the Rasch model. Open Journal of Statistics, 8(6), 873–884. https://doi.org/10.4236/ojs.2018.86058
12.
DraxlerC.ZessinJ. (2015). The power function of conditional tests of the Rasch model. AStA Advances in Statistical Analysis, 99(3), 367–378. https://doi.org/10.1007/s10182-015-0249-5
13.
FischerG. H. (1981). On the existence and uniqueness of maximum-likelihood estimates in the Rasch model. Psychometrika, 46(1), 59–77. https://doi.org/10.1007/BF02293919
GlasC. A. W.VerhelstN. D. (1995). Testing the Rasch model. In FischerG. H.MolenaarI. W. (Eds.), Rasch models: Foundations, recent developments, and applications (pp. 69–95). Springer. https://doi.org/10.1007/978-1-4612-4230-7_5
16.
GürerC.DraxlerC. (2022). Penalization approaches in the conditional maximum likelihood and Rasch modelling context. British Journal of Mathematical and Statistical Psychology, 00, 1–38. https://doi.org/10.1111/bmsp.12287
MairP.HatzingerR. (2007). Extended Rasch modeling: The eRm package for the application of IRT models in R. Journal of Statistical Software, 20(9), 1–20. https://doi.org/10.18637/jss.v020.i09
MillerJ. W.HarrisonM. T. (2013). Exact sampling and counting for fixed-margin matrices. The Annals of Statistics, 41(3), 1569–1592. https://doi.org/10.1214/13-AOS1131
22.
MolenaarI. W. (1995). Estimation of item parameters. In FischerG. H.MolenaarI. W. (Eds.), Rasch models: Foundations, recent developments, and applications (pp. 39–52). Springer. https://doi.org/10.1007/978-1-4612-4230-7_3
23.
MurakiE. (1992). A generalized partial credit model: Application of an EM algorithm. Applied Psychological Measurement, 16(2), 159–176. https://doi.org/10.1177/014662169201600206
24.
NeymanJ.ScottE. L. (1948). Consistent estimates based on partially consistent observations. Econometrica, 16(1), 1–32. https://doi.org/10.2307/1914288
25.
PfanzaglJ. (1993). On the consistency of conditional maximum likelihood estimators. Annals of the Institute of Statistical Mathematics, 45(4), 703–719. https://doi.org/10.1007/BF00774782
26.
R Core Team. (2022). R: A language and environment for statistical computing (4.2.0) [Computer software]. R Foundation for Statistical Computing. https://www.R-project.org/
27.
RaoC. R. (1948). Large sample tests of statistical hypotheses concerning several parameters with applications to problems of estimation. Mathematical Proceedings of the Cambridge Philosophical Society, 44(1), 50–57. https://doi.org/10.1017/S0305004100023987
28.
RaschG. (1960). Probabilistic models for some intelligence and attainment tests. Danish Institute for Educational Research.
SilveyS. D. (1959). The Lagrangian multiplier test. The Annals of Mathematical Statistics, 30(2), 389–407.
32.
SkrondalA.Rabe-HeskethS. (2022). The role of conditional likelihoods in latent variable modeling. Psychometrika, 87(3), 799–834. https://doi.org/10.1007/s11336-021-09816-8
33.
TerrellG. R. (2002). The gradient statistic. Computing Science and Statistics, 34(34), 206–215.
34.
VerhelstN. D. (2008). An efficient MCMC algorithm to sample binary matrices with fixed marginals. Psychometrika, 73(4), 705–728. https://doi.org/10.1007/s11336-008-9062-3
35.
VerhelstN. D.GlasC. A. W. (1995). The one parameter logistic model. In FischerG. H.MolenaarI. W. (Eds.), Rasch models: Foundations, recent developments, and applications (pp. 215–237). Springer. https://doi.org/10.1007/978-1-4612-4230-7_12
36.
VerhelstN. DGlasC. A. W.VerstralenH. H. F. M. (1994). One parameter logistic model [Computer program and manual]. CITO.
37.
WaldA. (1943). Tests of statistical hypotheses concerning several parameters when the number of observations is large. Transactions of the American Mathematical Society, 54(3), 426–482. https://doi.org/10.2307/1990256
38.
ZimmerF.DraxlerC.DebelakR. (2022). Power analysis for the Wald, LR, score, and gradient tests in a marginal maximum likelihood framework: Applications in IRT. Psychometrika. https://doi.org/10.1007/s11336-022-09883-5
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
