Interest in using Bayesian methods for estimating item response theory models has grown at a remarkable rate in recent years. This attentiveness to Bayesian estimation has also inspired a growth in available software such as WinBUGS, R packages, BMIRT, MPLUS, and SAS PROC MCMC. This article intends to provide an accessible overview of Bayesian methods in the context of item response theory to serve as a useful guide for practitioners in estimating and interpreting item response theory (IRT) models. Included is a description of the estimation procedure used by SAS PROC MCMC. Syntax is provided for estimation of both dichotomous and polytomous IRT models, as well as a discussion on how to extend the syntax to accommodate more complex IRT models.
AndrewsM.BaguleyT. (2013). Prior approval: The growth of Bayesian methods in psychology. British Journal of Mathematical and Statistical Psychology, 66, 1-7.
2.
AndrichD. (1978). A rating formulation for ordered response categories. Psychometrika, 43, 561-573.
3.
*BaldwinP.BernsteinJ.WainerH. (2009). Hip psychometrics. Statistics in Medicine, 28, 2277-2292.
4.
BockR. D. (1972). Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika, 37, 29-51.
5.
*BolfarineH.BazanJ. (2010). Bayesian estimation of the logistic positive exponent IRT model. Journal of Educational and Behavioral Statistics, 35, 693-713.
6.
BirnbaumA. (1968). Some latent trait models and their use in inferring an examinee’s ability. In LordF. M.NovickM. R. (Eds.), Statistical theories of mental test scores (pp. 395-479). Reading, MA: Addison-Wesley.
7.
CasellaG.BergerR. L. (1987). Reconciling Bayesian and frequentist evidence in the one-sided testing problem. Journal of the American Statistical Association, 82, 106-111.
8.
ChibS.GreenbergE. (1995), Understanding the Metropolis-Hastings algorithm. The American Statistician, 49, 327-335.
9.
*ChooS.CohenA.KimS. (2013). Markov chain Monte Carlo estimation of a mixture item response theory model. Journal of Statistical Computation and Simulation, 83, 278-306.
10.
*CuriM.SingerJ.AndradeD. (2011). A model for psychiatric questionnaires with embarrassing items. Statistical Methods in Medical Research, 20, 451-470.
11.
CurtisS. M. (2010). BUGS syntax for item response theory. Journal of Statistical Software, 36, 1-34.
12.
*De GooijerJ.YuanA. (2011). Some exact tests for manifest properties of latent trait models. Computational Statistics and Data Analysis, 55, 34-44.
13.
*de la TorreJ. (2009a). DINA model and parameter estimation: A didactic. Journal of Educational and Behavioral Statistics, 34, 115-130.
14.
*de la TorreJ. (2009b). Improving the quality of ability estimates through multidimensional scoring and interpretation of ancillary variables. Applied Psychological Measurement, 33, 465-485.
15.
*de la TorreJ.HongY. (2010). Parameter estimation with small sample size: A higher-order IRT model approach. Applied Psychological Measurement, 34, 267-285.
16.
*de la TorreJ.SongH. (2009). Simultaneous estimation of overall and domain abilities: A higher-order IRT model approach. Applied Psychological Measurement, 33, 620-639.
17.
*de la TorreJ.SongH.HongY. (2011). A comparison of four methods of IRT subscoring. Applied Psychological Measurement, 35, 296-316.
18.
*EdwardsM. (2010). A Markov chain Monte Carlo approach to confirmatory item factor analysis. Psychometrika, 75, 474-497.
19.
*EtnikR.FoxJ.-P.van den HoutA. (2011). A mixture model for the joint analysis of latent development trajectories and survival. Psychometrika, 74, 21-48.
20.
*EtnikR.FoxJ.-P.van der LindenW. J. (2011). A multivariate multilevel approach to the modeling of accuracy and speed of test takers. Statistics in Medicine, 30, 2310-2325.
21.
*FinkeD. (2009). Estimating the effect of nonseparable preferences in EU treaty negotiations. Journal of Theoretical Politics, 21, 543-569.
22.
FoxJ.-P. (2010). Bayesian item response modeling: Theory and applications. New York, NY: Springer; 2010.
23.
*FragosoT.CuriM. (2013). Improving psychometric assessment of the Beck Depression Inventory using multidimensional item response theory. Biometrical Journal, 55, 527-540.
24.
FraserC. (1998). NOHARM: A Fortran program for fitting unidimensional and multidimensional normal ogive models in latent trait theory. Armidale, New South Wales, Australia. The University of New England, Center for Behavioral Studies.
25.
*FuZ.-H.TaoJ.ShiN. (2009). Bayesian estimation of the multidimensional three-parameter logistic model. Journal of Statistical Computation and Simulation, 76, 819-835.
HastingsW. K. (1970), Monte Carlo sampling methods using Markov chains and their applications. Biometrika, 57, 97-109.
29.
*HensonR. A.TemplinJ.WillseJ. (2009). Defining a family of cognitive diagnosis models using log-linear models with latent variables. Psychometrika, 74, 191-210.
30.
*HsiehC.-A.von EyeA.MaierK. (2010). Using a multivariate multilevel polytomous item response model to study parallel processes of change: The dynamic association between adolescents’ social isolation and engagement with delinquent peers in the National Youth Survey. Multivariate Behavioral Research, 45, 508-552.
*HungL.-F. (2011). Formulation and application of the hierarchical generalized random-situation random-weight MIRID. Multivariate Behavioral Research, 46, 643-668.
34.
*HungL.-F.WangW.-C. (2012). The generalized multilevel facets model for longitudinal data. Journal of Educational and Behavioral Statistics, 37, 231-255.
35.
JackmanS. (2009). Bayesian analysis for the social sciences. Chichester, England: Wiley.
36.
*JangE. (2009). Cognitive diagnostic assessment of L2 reading comprehension ability: Validity arguments for fusion model application toLanguEdge assessment. Language Testing, 26, 31-73.
37.
*JiaoH.KamataA.WangS.JinY. (2012). A multilevel testlet model for dual local dependence. Journal of Educational Measurement, 49, 82-100.
38.
*JiaoH.WangS.HeW. (2013). Estimation methods for one-parameter testlet models. Journal of Educational Measurement, 50, 186-203.
39.
*KangT.CohenA.SungH.-J. (2009). Model selection indices for polytomous items. Applied Psychological Measurement, 33, 499-518.
40.
KimJ.-S.BoltD. M. (2007). Estimating item response theory models using Markov chain Monte Carlo methods. Educational Measurement: Issues and Practice, 26(4), 38-51.
41.
*KimS.DasS.ChenM.-H.WarrenN. (2009). Bayesian structural equation modeling for ordinal response data with missing responses and missing covariates. Communications in Statistics—Theory and Methods, 38, 2748-2768.
42.
*LiF.CohenA.KimS.-H.ChoS.-J. (2009). Model selection methods for mixture dichotomous IRT models. Applied Psychological Measurement, 33, 353-373.
43.
LiY.BaserR. (2012). Using R and WinBUGS to fit a generalized partial credit model for developing and evaluating patient-reported outcomes assessments. Statistics in Medicine, 31, 2010-2016.
44.
LunnD. J.ThomasA.BestN.SpiegelhalterD. (2000). Winbugs—A Bayesian modelling framework: Concepts, structure, and extensibility. Statistics and Computing, 10, 325-337.
45.
*LuoS.MaJ.KieburtzK. (2013). Robust Bayesian inference for multivariate longitudinal data by using normal/independent distributions. Statistics in Medicine, 32, 3812-3828.
46.
LynchS. M. (2007). Introduction to applied Bayesian statistics and estimation for social scientists. New York, NY: Springer.
47.
MacEachernS. N.BerlinerL. M. (1994). Subsampling the Gibbs sampler. The American Statistician, 48, 188-190.
48.
MartinA. D.QuinnK. M.ParkJ. H. (2011). MCMCpack: Markov chain Monte Carlo in R. Journal of Statistical Software, 42(9), 1-20.
49.
MetropolisN.RosenbluthA. W.RosenbluthM. N.TellerA. H.TellerE. (1953), Equation of state calculations by fast computing machines. Journal of Chemical Physics, 21, 1087-1092.
50.
MetropolisN.UlamS. (1949). The Monte Carlo method. Journal of the American Statistical Association, 44, 335-341.
51.
*MeyerJ. P. (2010). A mixture Rasch model with item response time components. Applied Psychological Measurement, 34, 521-538.
52.
MurakiE. (1992). A generalized partial credit model: application of an EM algorithm. Applied Psychological Measurement, 16, 159-176.
53.
MuthénL. K.MuthénB. O. (1998-2011). Mplus user’s guide (6th ed.). Los Angeles, CA: Muthén & Muthén.
54.
PatzR.JunkerB. (1999). A straightforward approach to Markov chain Monte Carlo methods for item response models. Journal of Educational and Behavioral Statistics, 24, 146-178.
55.
R Development Core Team. (2010). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing.
56.
SAS Institute Inc. (2012). SAS®on demand for academics: Student user’s guide (3rd ed). Cary, NC: Author.
57.
SAS Institute Inc. (2013). Getting Started with SAS
® Enterprise Miner™ 13.1. Cary, NC: Author.
58.
SAS Institute Inc. (2014). The MCMC procedure. Cary, NC: Author.
59.
*SaitoM.IwataN.KawakameN.MatsuyamaY., & World Mental Health Japan 2002-2003 collaborators. (2010). Evaluation of the DSM-IV and ICD-10 criteria for depressive disorders in a community population in Japan using item response theory. International Journal of Methods in Psychiatric Research, 19, 211-222.
60.
SamejimaF. (1969). Estimation of latent ability using a response pattern of graded scores. (Psychometrika Monograph No. 17) Richmond, VA: Psychometrics Society.
61.
*SantosJ.AzevedoC.BolfraineH. (2013). A multiple group item response theory model with centered skew-normal latent trait distributions under a Bayesian framework. Journal of Applied Statistics, 40, 2129-2149.
62.
SinharayS. (2005). Assessing fit of unidimensional item response theory models using a Bayesian approach. Journal of Educational Measurement, 42, 375-394.
63.
*SoaresT.GoncalvesF.GamermanD. (2009). An integrated Bayesian model for DIF analysis. Journal of Educational and Behavioral Statistics, 34, 348-377.
64.
Stan Development Team. 2014. Stan: A C++ library for probability and sampling, Version 2.2. http://mc-stan.org.
65.
StoneC.YeF.ZhuX.LaneS. (2009). Providing subscale scores for diagnostic information: A case study when the test is essentially unidimensional. Applied Measurement in Education, 23, 63-86. *
66.
*TaoJ.XuB.ShiN.-Z.JiaoH. (2013). Refining the two-parameter testlet response model by introducing testlet discrimination parameters. Japanese Psychological Research, 55, 284-291.
67.
TutzG. (1990). Sequential item response models with an ordered response. British Journal of Mathematical and Statistical Psychology, 43, 39-55.
68.
*UsamiS. (2011). Generalized graded unfolding model with structural equation for subject parameters. Japanese Psychological Research, 53, 221-232.
69.
*van den HoutA.BockenholtU.ven der HeijdenP. (2010). Estimating the prevalence of sensitive behaviour and cheating with a dual design for direct questioning and randomized response. Journal of the Royal Statistical Society, 59, 723-736.
70.
*WangX.BaldwinS.WainerH.BradlowE.ReeveB.SmithA.BellizziK.BaumgartnerK. (2010). Using testlet response theory to analyze data from a survey of attitude change among breast cancer survivors. Statistics in Medicine, 29, 2018-2044.
71.
YaoL. (2003). BMIRT: Bayesian multivariate item response theory [Computer software]. Monterey, CA: Defense Manpower Data Center.
72.
*YaoL. (2010). Reporting valid and reliable overall scores and domain scores. Journal of Educational Measurement, 47, 339-360.
