Multidimensional item response models are usually implemented to model the relationship between item responses and two or more traits of interest. We show how multidimensional multinomial logit item response models can also be used to account for individual differences in response style. This is done by specifying a factor-analytic model for latent responses at the category level. This permits traits and response style to be separated into separate but possibly correlated factors when properly identified by the factor structure. Special cases of this model can be viewed as generalizations of some unidimensional multinomial logit item response models. In this article, we describe and demonstrate the specification and implementation of these models to account for individual differences in response style that would otherwise compromise the validity of the measurement model.
AdamsR. J.WilsonM.WangW. (1997). The multidimensional random coefficients multinomial logit model. Applied Psychological Measurement, 21, 1–23.
2.
AndersonJ. A. (1984). Regression and ordered categorical variables (with discussion). Journal of the Royal Statistical Society: Series B, 46, 1–30.
3.
AndrewT.O’HaraB.LiggesU.SturtzS. (2006). Making BUGS open. R News, 6, 12–17.
4.
AndrichD. (1978). A rating formulation for ordered response categories. Psychometrika, 43, 561–573.
5.
BillietJ. B.McClendonM. J. (2000). Modeling acquiescence in measurement models for two balanced sets of items. Structural Equation Modeling, 7, 608–628.
6.
BockR. D. (1972). Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika, 37, 29–51.
7.
BöckenholtU. (2001). Thresholds and intransitiveness in pairwise judgments: A multilevel analysis. Journal of Educational and Behavioral Statistics, 26, 269–282.
8.
BollenK. A. (1989). Structural equations with latent variables. New York: Wiley.
9.
BoltD. M.JohnsonT. R. (2009). Addressing score bias and differential item functioning due to individual differences in response style. Applied Psychological Measurement, 33, 335–352.
10.
ClarkeI. sIII. (2001). Extreme response style in cross-cultural research. International Marketing Review, 18, 301–324.
11.
CronbachL. J. (1942). Studies of acquiescence as a factor in the true-false test. Journal of Educational Psychology, 33, 401–415.
12.
CronbachL. J. (1946). Response sets and test validity. Educational and Psychological Measurement, 6, 475–494.
13.
CronbachL. J. (1950). Further evidence on response sets and test design. Educational and Psychological Measurement, 10, 3–31.
14.
De BoeckP.WilsonM. (2004). Explanatory item response models: A generalized linear and nonlinear approach. New York: Springer-Verlag.
GollwitzerM.EidM.JürgensenR. (2005). Response styles in the assessment of anger expression. Psychological Assessment, 17, 56–69.
18.
HamiltonD. L. (1968). Personality attributes associated with extreme response style. Psychological Bulletin, 69, 192–203.
19.
HeinenT. (1996). Latent class and discrete latent trait models: Similarities and differences. Thousand Oaks, CA: Sage.
20.
HuiH. C.TriandisH. C. (1989). Effects of culture and response format on extreme response style. Journal of Cross-Cultural Psychology, 20, 296–309.
21.
JacksonD. N.MessickS. (1958). Content and style in personality assessment. Psychological Bulletin, 55, 243–252.
22.
JacksonD. N.MessickS. (1962). Response styles on the MAPI: Comparison of clinical and normal samples. The Journal of Abnormal and Social Psychology, 65, 285–299.
23.
JavarasK. N.RipleyB. D. (2007). An “unfolding” latent variable model for Likert attitude data: Drawing inferences adjusted for response style. Journal of the American Statistical Association, 478, 454–463.
24.
JohnsonT. R. (2003). On the use of heterogeneous thresholds ordinal regression models to account for individual differences in response style. Psychometrika, 68, 563–583.
25.
KeaneM. P. (1992). A note on identification in the multinomial probit model. Journal of Business & Economic Statistics, 10, 193–200.
26.
KennyD. A. (1979). Correlation and causality. New York: Wiley.
27.
LenkP.WedelM.BöckenholtU. (2006). Bayesian estimation of circumflex models subject to prior theory constraints and scale-usage bias. Psychometrika, 71, 33–55.
28.
LentzT. F. (1938). Acquiescence as a factor in the measurement of personality. Psychological Bulletin, 35, 659.
29.
Lorenzo-SevaU.Rodriguez-FornellsA. (2006). Acquiescent responding in balanced multidimensional scales and exploratory factor analysis. Psychometrika, 71, 769–777.
30.
LouviereJ. J.HensherD. A.SwaitJ. D. (2000). Stated choice models: Analysis and application. Cambridge, UK: Cambridge University Press.
31.
MarschakJ. (1960). Binary choice constraints on random utility indicator. In ArrowK. I.KarlinS.SuppesP. (Eds.), Stanford symposium on mathematical methods in the social sciences (pp. 312–329). Stanford, CA: Stanford University Press.
32.
MastersG. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149–174.
33.
Maydeu-OlivaresA.BöckenholtU. (2005). Structural equation modeling of paired comparison and ranking data. Psychological Methods, 10, 285–304.
34.
McCullochR.RossiP. E. (1994). An exact likelihood analysis of the multinomial probit model. Journal of Econometrics, 64, 207–240.
35.
McFaddenD. L. (1974). Conditional logit analysis of qualitative choice behavior. In ZarembkaP. (Ed.), Frontiers in Econometrics. New York: Academic Press.
36.
McFaddenD. L.TrainK. (2000). Mixed MNL models for discrete responses. Journal of Applied Econometrics, 15, 447–470.
37.
MessickS. (1968). Response sets. In SillsD. L. (Ed.), International Encyclopedia of the Social Sciences (Vol. 13, pp. 492–496). New York: Macmillan.
38.
MessickS. (1991). Psychology and methodology of response styles. In SnowR. E.WileyD. E. (Eds.), Improving inquiry in social science: A volume in honor of Lee J. Cronbach. (pp. 161–200). Hillsdale, NJ: Lawrence Erlbaum and Associates.
39.
MirowskyJ.RossC. E. (1991). Eliminating defense and agreement bias from measures of the sense of control: A 2 × 2 index. Social Psychology Quarterly, 54, 127–145.
40.
MoorsG. (2003). Diagnosing response style behavior by means of a latent-class factor approach. Socio-demographic correlates of gender role attitudes and perceptions of ethnic discrimination reexamined. Quality and Quantity, 37, 277–302.
41.
MurakiE. (1992). A generalized partial credit model: An application of an EM algorithm. Applied Psychological Measurement, 16, 159–176.
42.
NatarajanR.McCullochC. E.KieferN. M. (2000). A Monte Carlo EM method for estimating multinomial probabilities. Computational Statistics & Data Analysis, 34, 33–50.
43.
Rabe-HeskethS.SkrondalA.PicklesA. (2002). Reliable estimation of generalized linear mixed models using adaptive quadrature. The Stata Journal, 2, 1–21.
44.
RostJ. (1991). A logistic mixture distribution model for polytomous item responses. British Journal of Mathematical and Statistical Psychology, 44, 75–92.
45.
SAS Institute. (2000). SAS/STAT User’s Guide (Version 8). Cary, NC: Author.
46.
SkrondalA.Rabe-HeskethS. (2003). Multilevel logistic regression for polytomous data and rankings. Psychometrika, 68, 267–287.
47.
TakaneY.de LeeuwJ. (1987). On the relationship between item response theory and factor analysis of discretized variables. Psychometrika, 52, 393–408.
48.
ThissenD.SteinbergL. (1986). A taxonomy of item response models. Psychometrika, 51, 567–578.
49.
ThurstoneL. L. (1927). A law of comparative judgment. Psychological Review, 34, 273–286.
50.
ThurstoneL. L. (1931). The indifference function. Journal of Social Psychology, 2, 139–167.
51.
VansteelandtK. (2000). Formal models for contextualized personality psychology. Unpublished doctoral dissertation, K. U. Leuven, Belgium.
WeeksM. (1997). The multinomial probit model revisited: A discussion of parameter estimability, identification and specification testing. Journal of Economic Surveys, 11, 297–320.
