Sage Journals: Discover world-class research

Abstract

This paper presents a mixture item response tree (IRTree) model for extreme response style. Unlike traditional applications of single IRTree models, a mixture approach provides a way of representing the mixture of respondents following different underlying response processes (between individuals), as well as the uncertainty present at the individual level (within an individual). Simulation analyses reveal the potential of the mixture approach in identifying subgroups of respondents exhibiting response behavior reflective of different underlying response processes. Application to real data from the Students Like Learning Mathematics (SLM) scale of Trends in International Mathematics and Science Study (TIMSS) 2015 demonstrates the superior comparative fit of the mixture representation, as well as the consequences of applying the mixture on the estimation of content and response style traits. We argue that methodology applied to investigate response styles should attend to the inherent uncertainty of response style influence due to the likely influence of both response styles and the content trait on the selection of extreme response categories.

Keywords

mixture IRTree model mixture modeling item response theory extreme response style self-report rating scale

Get full access to this article

View all access options for this article.

References

Adams

D. J.

Bolt

D. M.

Deng

Smith

S. S.

Baker

T. B.

(2019). Using multidimensional item response theory to evaluate how response styles impact measurement. British Journal of Mathematical and Statistical Psychology, 72(3), 466-485. https://doi.org/10.1111/bmsp.12169

Austin

E. J.

Deary

I. J.

Egan

(2006). Individual differences in response scale use: Mixed Rasch modelling of responses to NEO-FFI items. Personality and Individual Differences, 40(6), 1235-1245. https://doi.org/10.1016/j.paid.2005.10.018

Böckenholt

(2012). Modeling multiple response processes in judgment and choice. Psychological Methods, 17(4), 665-678. https://doi.org/10.1037/a0028111

Böckenholt

Meiser

(2017). Response style analysis with threshold and multi-process IRT models: A review and tutorial. British Journal of Mathematical and Statistical Psychology, 70(1), 159-181. https://doi.org/10.1111/bmsp.12086

Bolt

D. M.

Johnson

T. R.

(2009). Applications of a MIRT model to self-report measures: Addressing score bias and DIF due to individual differences in response style. Applied Psychological Measurement, 33(5), 335-352. https://doi.org/10.1177/0146621608329891

Chen

Lee

Stevenson

H. W.

(1995). Response style and cross-cultural comparisons of rating scales among East Asian and North American students. Psychological Science, 6(3), 170-175. https://doi.org/10.1111/j.1467-9280.1995.tb00327.x

De Boeck

Partchev

. (2012). IRTrees: Tree-based item response models of the GLMM family. Journal of Statistical Software, 48(1), 1-28. https://doi.org/10.18637/jss.v048.c01

De Jong

M. G.

Steenkamp

J.-B. E. M.

Fox

J.-P.

Baumgartner

. (2008). Using item response theory to measure extreme response style in marketing research: A global investigation. Journal of Marketing Research, 45(1), 104-115. https://doi.org/10.1509/jmkr.45.1.104

Greenleaf

E. A.

(1992). Measuring extreme response style. Public Opinion Quarterly, 56(3), 328-351. https://doi.org/10.1086/269326

10.

Jeon

De Boeck

(2016). A generalized item response tree model for psychological assessments. Behavior Research Methods, 48(3), 1070-1085. https://doi.org/10.3758/s13428-015-0631-y

11.

Johnson

Kulesa

Cho

Y. I.

Shavitt

(2005). The relation between culture and response styles: Evidence from 19 countries. Journal of Cross-Cultural Psychology, 36(2), 264-277. https://doi.org/10.1177/0022022104272905

12.

Kellner

(2019). jagsUI: A wrapper around “rjags” to Streamline “JAGS” analyses (R package Version 1.5.1). https://github.com/kenkellner/jagsUI

13.

Khorramdel

von Davier

(2014). Measuring response styles across the big five: A multiscale extension of an approach using multinomial processing trees. Multivariate Behavioral Research, 49(2), 161-177. https://doi.org/10.1080/00273171.2013.866536

14.

Khorramdel

von Davier

Pokropek

(2019). Combining mixture distribution and multidimensional IRTree models for the measurement of extreme response styles. British Journal of Mathematical and Statistical Psychology, 72(3), 538-559. https://doi.org/10.1111/bmsp.12179

15.

Meisenberg

Williams

(2008). Are acquiescent and extreme response styles related to low intelligence and education? Personality and Individual Differences, 44(7), 1539-1550. https://doi.org/10.1016/j.paid.2008.01.010

16.

Meiser

Plieninger

Henninger

(2019). IRTree models with ordinal and multidimensional decision nodes for response styles and trait-based rating responses. British Journal of Mathematical and Statistical Psychology, 72(3), 501-516. https://doi.org/10.1111/bmsp.12158

17.

Naemi

B. D.

Beal

D. J.

Payne

S. C.

(2009). Personality predictors of extreme response style. Journal of Personality, 77(1), 261-286. https://doi.org/10.1111/j.1467-6494.2008.00545.x

18.

Park

A. D.

(2019). Item response tree models to investigate acquiescence and extreme response styles in Likert-type rating scales. Educational and Psychological Measurement, 79(5), 911-930. https://doi.org/10.1177/0013164419829855

19.

Paulhus

D. L.

(1991). Measurement and control of response bias. In Robinson

J. P.

Shaver

P. R.

Wrightsman

L. S.

(Eds.), Measures of personality and social psychological attitudes (Vol. 1, pp. 17-59). Academic Press. https://doi.org/10.1016/B978-0-12-590241-0.50006-X

20.

Plieninger

Meiser

(2014). Validity of multiprocess IRT models for separating content and response styles. Educational and Psychological Measurement, 74(5), 875-899. https://doi.org/10.1177/0013164413514998

21.

Plummer

(2017). JAGS version 4.3. 0 user manual [Computer software manual]. sourceforge.net/projects/mcmc-jags/files/Manuals/4.x

22.

Tijmstra

Bolsinova

Jeon

(2018). General mixture item response models with different item response structures: Exposition with an application to Likert scales. Behavior Research Methods, 50(6), 2325-2344. https://doi.org/10.3758/s13428-017-0997-0

23.

Van Vaerenbergh

Thomas

T. D

. (2013). Response styles in survey research: A literature review of antecedents, consequences, and remedies. International Journal of Public Opinion Research, 25(2), 195-217. https://doi.org/10.1093/ijpor/eds021

24.

von Davier

Rost

(1995). Polytomous mixed Rasch models. In Fischer

G. H.

Molenaar

I. W.

(Eds.), Rasch models—Foundations, recent developments and applications (pp. 371-379). Springer. https://doi.org/10.1007/978-1-4612-4230-7_20

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.31 MB

0.16 MB

0.09 MB

A Mixture IRTree Model for Extreme Response Style: Accounting for Response Process Uncertainty

Abstract

Keywords

Get full access to this article

References

Supplementary Material