Most unfolding item response models for graded-response items are unidimensional. When there are multiple tests of graded-response items, unidimensional unfolding models become inefficient. To resolve this problem, the authors developed the confirmatory multidimensional generalized graded unfolding model, which is a multidimensional extension of the generalized graded unfolding model, and conducted a series of simulations to evaluate its parameter recovery. The simulation study on between-item multidimensionality demonstrated that the parameters of the new model can be recovered fairly well with the WinBUGS program. The Tattoo Attitude Questionnaire, with three subscales, was analyzed to demonstrate the advantages of the new model over the unidimensional model in obtaining a better model-data fit, a higher test reliability, and a stronger correlation between latent traits. Discussion on potential applications and suggestion for future studies are provided.
AdamsR. J.WilsonM.WangW.-C. (1997). The multidimensional random coefficients multinomial logit model. Applied Psychological Measurement, 21, 1-23.
2.
AndrichD.LuoG. (1993). A hyperbolic cosine latent trait model for unfolding dichotomous single-stimulus responses. Applied Psychological Measurement, 17, 253-276.
3.
CarterN. T.DalalD. K.BoyceA. S.O’ConnellM. S.KungM.-C.DelgadoK. (2014). Uncovering curvilinear relationships between conscientiousness and job performance: How theoretically appropriate measurement makes an empirical difference. Journal of Applied Psychology, 99, 564-586.
4.
CarterN. T.ZickarM. J. (2011). The influence of dimensionality on parameter estimation accuracy in the generalized graded unfolding model. Educational and Psychological Measurement, 71, 765-788.
5.
ChernyshenkoO. S.StarkS.DrasgowF.RobertsB. W. (2007). Constructing personality scales under the assumptions of an ideal point response process: Toward increasing the flexibility of personality measures. Psychological Assessment, 19, 88-106.
6.
DeSarboW. S.HoffmanD. L. (1987). Constructing MDS joint spaces from binary choice data: A multidimensional unfolding threshold model for marketing research. Journal of Marketing Research, 24, 40-54.
7.
GelfandA. E.DeyD. K. (1994). Bayesian model choice: Asymptotics and exact calculations. Journal of the Royal Statistical Society, Series B, 56, 501-514.
8.
GelmanA.MengX.-L.SternH. S. (1996). Posterior predictive assessment of model fitness via realized discrepancies. Statistica Sinica, 6, 733-807.
9.
GewekeJ. (1992). Evaluating the accuracy of sampling-based approaches to calculating posterior moments. In BernardoJ. M.BergerJ.DawidA. P.SmithJ. F. M. (Eds.), Bayesian statistics 4 (pp. 169-193). Oxford, UK: Oxford University Press.
LinR.-C.HuangB.-F. (2005). Tattooing and juvenile delinquency in Taiwan. Indigenous Psychological Research in Chinese Societies, 23, 321-372.
12.
LuoG. (2001). A class of probabilistic unfolding models for polytomous responses. Journal of Mathematical Psychology, 45, 224-248.
13.
Maydeu-OlivaresA.HernandezA.McDonaldR. P. (2006). A multidimensional ideal point item response theory model for binary data. Multivariate Behavioral Research, 41, 445-471.
14.
MengX.-L. (1994). Posterior predictive p-values. The Annals of Statistics, 22, 1142-1160.
15.
MurakiE. (1992). A generalized partial credit model: Application of an EM algorithm. Applied Psychological Measurement, 16, 159-176.
16.
RafteryA. E.NewtonM. A.SatagopanJ.KrivitskyP. (2007). Estimating the integrated likelihood via posterior simulation using harmonic mean identity. In BernardoJ.BayarriJ.BergerJ. (Eds.), Bayesian statistics 8 (pp. 1-45). London, England: Oxford University Press.
17.
ReckaseM. (2009). Multidimensional item response theory. New York, NY: Springer.
18.
RobertsJ. S. (2001). Computer program exchange: GGUM2000: Estimation of parameters in the generalized graded unfolding model. Applied Psychological Measurement, 25, 38.
19.
RobertsJ. S. (2008). Modified likelihood-based item fit statistics for the generalized graded unfolding model. Applied Psychological Measurement, 32, 407-423.
20.
RobertsJ. S.DonoghueJ. R.LaughlinJ. E. (2000). A general item response theory model for unfolding unidimensional polytomous responses. Applied Psychological Measurement, 24, 3-32.
21.
RobertsJ. S.DonoghueJ. R.LaughlinJ. E. (2002). Characteristics of MML/EAP parameter estimates in the generalized graded unfolding model. Applied Psychological Measurement, 26, 192-207.
22.
RobertsJ. S.LaughlinJ. E. (1996). A unidimensional item response model for unfolding responses from a graded disagree-agree response scale. Applied Psychological Measurement, 20, 231-255.
23.
RobertsJ. S.ShimH. S. (2010, July). Multidimensional unfolding with item response theory: The multidimensional generalized graded unfolding model. Paper presented at the IMPS 2010 Annual Meeting, Athens, GA.
24.
RobertsJ. S.ThompsonV. M. (2011). Marginal maximum a posteriori item parameter estimation for the generalized graded unfolding model. Applied Psychological Measurement, 35, 259-279.
25.
SpectorP. E. (1997). Job satisfaction: Application, assessment, causes, and consequences. Thousand Oaks, CA: Sage.
26.
SpiegelhalterD.BestN.CarlinB.van der LindeA. (2002). Bayesian measures of model complexity and fit. Journal of the Royal Statistical Society, 64, 583-639.
27.
SpiegelhalterD.ThomasA.BestN.LunnD. (2003). WinBUGS (version 1.4) [Computer program]. Cambridge, UK: MRC Biostatistics Unit, Institute of Public Health.
28.
StarkS.ChernyshenkoO. S.DrasgowF.WilliamsB. A. (2006). Examining assumptions about item responding in personality assessment: Should ideal point methods be considered for scale development and scoring?Journal of Applied Psychology, 91, 25-39.
29.
TakaneY. (1996). An item response model for multidimensional analysis of multiple-choice data. Behaviormetrika, 23, 153-167.
30.
WangW.-C.ChenP.-H.ChengY.-Y. (2004). Improving measurement precision of test batteries using multidimensional item response models. Psychological Methods, 9, 116-136.
31.
WangW.-C.LiuC.-W.WuS.-L. (2013). The random-threshold generalized unfolding model and its application of computerized adaptive testing. Applied Psychological Measurement, 37, 179-200.
32.
WangW.-C.LiuC.-Y. (2007). Formulation and application of the generalized multilevel facets model. Educational and Psychological Measurement, 67, 583-605.
