This article extends a methodological approach considered by Bolt and Johnson for the measurement and control of extreme response style (ERS) to the analysis of rating data from multiple scales. Specifically, it is shown how the simultaneous analysis of item responses across scales allows for more accurate identification of ERS, and more effective control of ERS effects on the substantive trait estimates, than when analyzing just one scale. Moreover, unlike a competing approach presented by Greenleaf, the current strategy can accommodate conditions in which the substantive traits across scales correlate, as is almost always the case in social sciences research. Simulation and real data analyses are used for illustration.
BachmanJ. G.O’MalleyP. M. (1984). Yea-saying, nay-saying, and going to extremes: Black-white differences in response styles. Public Opinion Quarterly, 48, 491-509.
2.
BaumgartnerJ. E. M.SteenkampH. (2001). Response style in marketing research: A cross-national investigation. Journal of Marketing Research, 38, 143-156.
3.
BergI. A.CollierJ. S. (1953). Personality and group differences in extreme response sets. Educational and Psychological Measurement, 13, 164-169.
4.
BockR. D. (1972). Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika, 37, 29-51.
5.
BoltD. M.JohnsonT. R. (2009). Applications of a MIRT model to self-report measures: Addressing score bias and DIF due to individual differences in response style. Applied Psychological Measurement, 33, 335-352.
6.
BuckleyJ. (2009, June). Cross-national response styles in international educational assessments: Evidence from PISA 2006. NCES Conference on the Program for International Student Assessment: What we can learn from PISA, Washington, DC. Retrieved from https://edsurveys.rti.org/PISA/
7.
CronbachL. J. (1946). Response sets and test validity. Educational and Psychological Measurement, 6, 475-494.
8.
De JongM. G.SteenkampJ.-B. E. M.FoxJ.-P.BaumgartnerH. (2008). Using item response theory to measure extreme response style in marketing research: A global investigation. Journal of Marketing Research, 45, 104-115.
9.
GreenleafE. A. (1992a). Improving rating scale measures by detecting and correcting bias components in some response styles. Journal of Marketing Research, 29, 176-188.
10.
GreenleafE. A. (1992b). Measuring extreme response style. Public Opinion Quarterly, 56, 328-351.
11.
HuiC. H.TriandisH. C. (1989). Effects of culture and response format on extreme response style. Journal of Cross-Cultural Psychology, 20, 296-309.
12.
JohnsonT. R. (2003). On the use of heterogeneous thresholds ordinal regression models to account for individual differences in response style. Psychometrika, 68, 563-583.
13.
JohnsonT. R.BoltD. M. (2010). On the use of factor-analytic multinomial logit item response models to account for individual differences in response style. Journal of Educational and Behavioral Statistics, 35, 92-114.
14.
LewisN. ATaylorJ. A. (1955). Anxiety and extreme preferences. Educational and Psychological Measurement, 15, 111-116.
15.
Maij-de MeijA. M.KeldermanH.van der FlierH. (2008). Fitting a mixture item response theory model to personality questionnaire data: Characterizing latent classes and investigating possibilities for improving prediction. Applied Psychological Measurement, 32, 611-631.
16.
MarinG.GambaR. J.MarinB. V. (1992). Extreme response style and acquiescence among Hispanics: The role of acculturation and education. Journal of Cross-Cultural Psychology, 23, 498-509.
17.
MastersG. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149-174.
18.
Maydeu-OlivaresA.CoffmanD. L. (2006). Random intercept item factor analysis. Psychological Methods, 11, 344-362.
19.
MoorsG. (2003). Diagnosing response style behavior by means of a latent-class factor approach: Socio-demographic correlates of gender role attitudes and perceptions of ethnic discrimination reexamined. Quality and Quantity, 37, 277-302.
20.
MoorsG. (2004). Facts and artifacts in the comparison of attitudes among ethnic minorities. A multigroup latent class structure model with adjustment for response style behavior. European Sociological Review, 20, 303-320.
21.
RossiP. E.GilulaZ.AllenbyG. M. (2001). Overcoming scale usage heterogeneity: A Bayesian hierarchical approach. Journal of the American Statistical Association, 96, 20-31.
22.
RostJ.CarstensenC.von DavierM. (1997). Applying the mixed Rasch model to personality questionnaires. In RostJ.LangeheineR. (Eds.), Applications of latent trait and latent class models in the social sciences (pp. 324-332). Münster, Germany: Waxmann.
23.
van RosmalenJ.van HerkH.GroenenP. J. F. (2010). Identifying response styles: A latent-class bilinear multinomial logit model. Journal of Marketing Research, 47, 157-172.
24.
VermuntJ. K.MagidsonJ. (2005). Technical guide for Latent Gold 4.0: Basic and advanced. Belmont, MA: Statistical Innovations.
