We propose the use of balanced item parcels to account for method effects caused by acquiescent responding. The use of balanced parcels avoids the need to model method effects explicitly and results in a parsimonious specification of measurement and full structural equation models in the presence of unwanted method effects, particularly when a scale consists of a relatively large number of items. Balanced item parcels are sums or averages of individual items consisting of an equal number of regular and reversed items measuring the same construct. When regular and reversed items are combined into parcels, method effects cancel out (assuming that the method effects affecting the regular and reversed items in a parcel are equal in magnitude), and model fit and parameter estimates will no longer be negatively affected by acquiescent responding. We discuss why balanced item parceling works and when it is likely to prove beneficial, and we present a step-by-step procedure explaining how to use balanced item parceling in practice. We also report a brief hypothetical example to illustrate the proposed approach.
BandalosD. L. (2002). The effects of item parceling on goodness-of-fit and parameter estimate bias in structural equation modeling. Structural Equation Modeling, 9(1), 78–102.
2.
BandalosD. L.FinneyS. J. (2001). Item parceling issues in structural equation modeling. In MarcoulidesG. A.SchumackerR. E. (Eds.), New developments and techniques in structural equation modeling (pp. 269–296). Lawrence Erlbaum.
3.
BaumgartnerH.SteenkampJ.-B. E. M. (2001). Response styles in marketing research: A cross-national investigation. Journal of Marketing Research, 38, 143–156.
4.
BillietJ.DavidovE. (2008). Testing the stability of an acquiescence style factor behind two interrelated substantive variables in a panel design. Sociological Methods and Research, 36(4), 542–562.
5.
BillietJ.McClendonM. J. (2000). Modeling acquiescence in measurement models for two balanced sets of items. Structural Equation Modeling: A Multidisciplinary Journal, 7, 608–628.
6.
BourdageJ. S.WiltshireJ.LeeK. (2015). Personality and workplace impression management: Correlates and implications. Journal of Applied Psychology, 100(2), 537–546.
7.
CheungG. W.RensvoldR. B. (2000). Assessing extreme and acquiescence response sets in cross-cultural research using structural equations modeling. Journal of Cross-Cultural Psychology, 31(2), 187–212.
8.
DannerD.AichholzerJ.RammstedtB. (2015). Acquiescence in personality questionnaires: Relevance, domain specificity, and stability. Journal of Research in Personality, 57, 119–130.
9.
HershfieldH. E.CohenT. R.ThompsonL. (2012). Short horizons and tempting situations: Lack of continuity to our future selves leads to unethical decision making and behavior. Organizational Behavior and Human Decision Processes, 117(2), 298–310.
10.
HoltJ. K. (2004, October). Item parceling in structural equation models for optimum solutions [Paper presentation]. Annual Meeting of the mid-Western Educational Research Association, Columbus, OH, United States.
11.
HuangJ. L.CurranP. G.KeeneyJ.PoposkiE. M.DeShonR. P. (2012). Detecting and deterring insufficient effort responding to surveys. Journal of Business and Psychology, 27, 99–114.
12.
HuangJ. L.LiuM.BowlingN. A. (2015). Insufficient effort responding: Examining an insidious confound in survey data. Journal of Applied Psychology, 100(3), 828–845.
13.
JohnO. P.SrivastavaS. (1999). The Big Five trait taxonomy: History, measurement, and theoretical perspectives. In PervinL. A.JohnO. P. (Eds.), Handbook of personality: Theory and research (pp. 102–138). Guilford Press.
14.
JudgeT. A.ErezA.BonoJ. E.ThoresenC. J. (2003). The core self-evaluations scale: Development of a measure. Personnel Psychology, 56(2), 303–331.
15.
KamC. C. S. (2016). Further considerations in using items with diverse content to measure acquiescence. Educational and Psychological Measurement, 76(1), 164–174.
16.
KamC. C. S.ChanG. H.-h. (2018). Examination of the validity of instructed response items in identifying careless respondents. Personality and Individual differences, 129, 83–87.
17.
KamC. C. S.FanX. (2020). Investigating response heterogeneity in the context of positively and negatively worded items by using factor mixture modeling. Organizational Research Methods, 23(2), 322–341.
18.
KamC. C. S.MeyerJ. P. (2015). How careless responding and acquiescence response bias can influence construct dimensionality: The case of job satisfaction. Organizational Research Methods, 18(3), 512–541.
19.
LeeK.AshtonM. C. (2004). Psychometric properties of the HEXACO personality inventory. Multivariate Behavioral Research, 39(2), 329–358.
20.
LeeK.AshtonM. C. (2007). The HEXACO Personality Inventory-Revised[Unpublished manuscript].
21.
LeeK.AshtonM. C. (2018). Psychometric properties of the HEXACO-100. Assessment, 25(5), 543–556.
22.
LiW.-D.LiS.FayD.FreseM. (2019). Reciprocal relationships between dispositional optimism and work experiences: A five-wave longitudinal investigation. Journal of Applied Psychology, 104(12), 1471–1486.
23.
LittleT. D.CunninghamW. A.ShaharG.WidamanK. F. (2002). To parcel or not to parcel: Exploring the question, weighing the merits. Structural Equation Modeling, 9(2), 151–173.
24.
LiuZ.RiggioR. E.DayD. V.ZhengC.DaiS.BianY. (2019). Leader development begins at home: Overparenting harms adolescent leader emergence. Journal of Applied Psychology, 104(10), 1226–1242.
25.
MarshH. W.LüdtkeO.NagengastB.MorinA. J.Von DavierM. (2013). Why item parcels are (almost) never appropriate: Two wrongs do not make a right—Camouflaging misspecification with item parcels in CFA models. Psychological Methods, 18(3), 257–284.
26.
Maydeu-OlivaresA.CoffmanD. L. (2006). Random intercept item factor analysis. Psychological Methods, 11(4), 344–362. doi:10.1037/1082-989X.11.4.344
27.
McClendonM. J. (1991). Acquiescence and response-order effects in interview surveys. Sociological Methods and Research, 20(1), 60–103.
28.
MirowskyJ.RossC. E. (1991). Eliminating defense and agreement bias from measures of the sense of control: A 2x2 index. Social Psychology Quarterly, 54(2), 127–145.
29.
PaulhusD. L. (1991). Measurement and control of response bias. In RobinsonJ. P.ShaverP. R.WrightsmanL. S. (Eds.), Measures of personality and social psychological attitudes (pp. 17–60). Academic Press.
30.
PodsakoffP. M.MacKenzieS. B.LeeJ.-Y.PodsakoffN. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903.
31.
RhemtullaM. (2016). Population performance of SEM parceling strategies under measurement and structural model misspecification. Psychological Methods, 21(3), 348–368. doi:10.1037/met0000072
32.
RosenbergM. (1965). Society and the adolescent child. Princeton, NJ: Princeton University Press.
33.
ScheierM. F.CarverC. S.BridgesM. W. (1994). Distinguishing optimism from neuroticism (and trait anxiety, self-mastery, and self-esteem)—A reevaluation of the Life Orientation Test. Journal of Personality and Social Psychology, 67(6), 1063–1078. doi:10.1037/0022-3514.67.6.1063
34.
SpectorP. E. (1997). Job satisfaction: Application, assessment, causes, and consequences (Vol. 3). SAGE.
35.
SterbaS. K. (2011). Implications of parcel-allocation variability for comparing fit of item-solutions and parcel-solutions. Structural Equation Modeling: A Multidisciplinary Journal, 18(4), 554–577.
36.
SterbaS. K.PekJ. (2012). Individual influence on model selection. Psychological Methods, 17(4), 582–599.
37.
SterbaS. K.RightsJ. D. (2017). Effects of parceling on model selection: Parcel-allocation variability in model ranking. Psychological Methods, 22(1), 47–68.
38.
TourangeauR.RipsL. J.RasinskiK. A. (2000). The Psychology of survey response. Cambridge University Press.
39.
WatsonD. (1992). Correcting for acquiescent response bias in the absence of a balanced scale: An application to class consciousness. Sociological Methods and Research, 21(1), 52–88.
40.
WeijtersB.BaumgartnerH. (2012). Misresponse to reversed and negated items in surveys: A review. Journal of Marketing Research, 49(5), 737–747.
WeijtersB.GeuensM.SchillewaertN. (2010). The individual consistency of acquiescence and extreme response style in self-report questionnaires. Applied Psychological Measurement, 34(2), 105–121.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
