There are important advantages to including reversed items in questionnaires (e.g., control of acquiescence, disruption of nonsubstantive responding, better coverage of the domain of content of a construct), but reversed items can also lead to measurement problems (e.g., low measure reliability, complex factor structures). The authors advocate the continued use of reversed items in measurement instruments but also argue that they should be used with caution. To help researchers improve their scale construction practices, the authors provide a comprehensive review of the literature on reversed and negated items and offer recommendations about their use in questionnaires. The theoretical discussion is supplemented with data on 1330 items from measurement scales that have appeared in Journal of Marketing Research and Journal of Consumer Research.
Arce-FerrerAlvara J. (2006), “An Investigation into the Factors Influencing Extreme-Response Style, ”Educational and Psychological Measurement, 66 (3), 374–92.
2.
BaumgartnerHans, and Jan-BenedictE.M. Steenkamp (2001), “Response Styles in Marketing Research: A Cross-National Investigation, ”Journal of Marketing Research, 38 (May), 143–56.
3.
BentlerPeter M., DouglasN. Jackson, and MessickSamuel (1971), “Identification of Content and Style: A Two-Dimensional Interpretation of Acquiescence, ”Psychological Bulletin, 76 (3), 186–204.
4.
BuddRichard J. (1987), “Response Bias and the Theory of Reasoned Action, ”Social Cognition, 5 (1), 95–107.
5.
CarpenterPatricia A., and JustMarcel Adam (1975), “Sentence Comprehension: A Psycholinguistic Processing Model of Verification, ”Psychological Review, 82 (1), 45–73.
6.
ChurchillGilbert A.Jr. (1979), “A Paradigm for Developing Better Measures of Marketing Constructs, ”Journal of Marketing Research, 16 (February), 64–73.
7.
DaviesMartin F. (2003), “Confirmatory Bias in the Evaluation of Personality Descriptions: Positive Test Strategies and Output Interference, ”Journal of Personality and Social Psychology, 85 (4), 736–44.
8.
DeeseJames E (1965), The Structure of Associations in Language and Thought.Baltimore: Johns Hopkins.
9.
DeMaioTheresa J., and JenniferM. Rothgeb (1996), “Cognitive Interviewing Techniques: In the Lab and in the Field, ” in Answering Questions: Methodology for Determining Cognitive and Communicative Processes in Survey Research, SchwarzNorbert, and SudmanSeymour, eds. San Francisco: Jossey-Bass, 177–95.
10.
DeVellisRobert F. (2003), Scale Development: Theory and Applications, 2d ed. Thousand Oaks, CA: Sage Publications.
11.
DicksonJohn, and AlbaumGerald (1977), “A Method for Developing Tailormade Semantic Differentials for Specific Marketing Content Areas, ”Journal of Marketing Research, 14 (February), 87–91.
12.
DroletAimee, and DonaldG. Morrison (2001), “Do We Really Need Multiple-Item Measures in Service Research?”Journal of Service Research, 3 (3), 196–204.
13.
EricssonK. Anders, and HerbertA. Simon (1980), “Verbal Reports as Data, ”Psychological Review, 87 (3), 215–51.
14.
FeldmanJack M., and JohnG. LynchJr. (1988), “Self-Generated Validity and Other Effects of Measurement on Belief, Attitude, Intention, and Behavior, ”Journal of Applied Psychology, 73 (3), 421–35.
15.
GannonKatherine M., and ThomasM. Ostrom (1996), “How Meaning Is Given to Rating Scales: The Effects of Response Language on Category Activation, ”Journal of Experimental Social Psychology, 32 (4), 337–60.
16.
HornLawrence R. (1989), A Natural History of Negation.Chicago: University of Chicago Press.
17.
KnowlesEric S., and ChristopherA. Condon (1999), “Why People Say 'Yes': A Dual-Process Theory of Acquiescence, ”Journal of Personality and Social Psychology, 77 (2), 379–86.
18.
KrosnickJon A. (1991), “Response Strategies for Coping with the Cognitive Demands of Measures in Surveys, ”Applied Cognitive Psychology, 5 (3), 213–36.
19.
KundaZiva, GeoffreyT. Fong, SanitiosoRasyid, and ReberEmily (1993), “Directional Questions Direct Self-Conceptions, ”Journal of Experimental Social Psychology, 29 (1), 63–86.
20.
MarshHerbert W. (1996), “Positive and Negative Global Self-Esteem: A Substantively Meaningful Distinction or Artifactors?”Journal of Personality and Social Psychology, 70 (4), 810–19.
21.
MarshHerbert W., and ParducciAllen (1978), “Natural Anchoring at the Neutral Point of Category Rating Scales, ”Journal of Experimental Social Psychology, 14 (2), 193–204.
22.
MayoRuth, SchulYaacov, and BurnsteinEugene (2004), “‘I Am Not Guilty’ vs. ‘I Am Innocent’: Successful Negation May Depend on the Schema Used for its Encoding, ”Journal of Experimental Social Psychology, ” 40 (4), 433–49.
23.
McPhersonJason, and MohrPhilip (2005), “The Role of Item Extremity in the Emergence of Keying-Related Factors: An Exploration with the Life Orientation Test, ”Psychological Methods, 10 (1), 120–31.
24.
NunnallyJum C. (1978), Psychometric Theory, 2d ed. New York: McGraw-Hill.
25.
ParadisCarita, and WillnersCaroline (2006), “Antonymy and Negation: The Boundedness Hypothesis, ”Journal of Pragmatics, 38 (7), 979–1144.
26.
PaulhusDelroy L. (1991), “Measurement and Control of Response Bias, ” in Measures of Personality and Social Psychological Attitudes, JohnP. Robinson, PhillipR. Shaver, and LawrenceS. Wright, eds. San Diego: Academic Press, 17–59.
27.
PodsakoffPhilip M., ScottB. MacKenzie, LeeJeong-Yeon, and NathanP. Podsakoff (2003), “Common Method Biases in Behavioral Research: A Critical Review of the Literature and Recommended Remedies, ”Journal of Applied Psychology, 88 (5), 879–903.
28.
RichinsMarsha L., and DawsonScott (1992), “A Consumer Values Orientation for Materialism and Its Measurement: Scale Development and Validation, ”Journal of Consumer Research, 19 (3), 303–316.
29.
SchmittNeal, and DanielM. Stults (1985), “Factors Defined by Negatively Coded Items: The Result of Careless Respondents?”Applied Psychological Measurement, 9 (4), 367–73.
30.
SchriesheimChester A., ReginaJ. Eisenbach, and KennethD. Hill (1991), “The Effect of Negation and Polar Opposite Item Reversals on Questionnaire Reliability and Validity: An Experimental Investigation, ”Educational and Psychological Measurement, 51 (1), 67–78.
31.
SwainScott D., WeathersDanny, and RonaldW. Niedrich (2008), “Assessing Three Sources of Misresponse to Reversed Likert Items, ”Journal of Marketing Research, 45 (February), 116–31.
32.
TourangeauRoger, LanceJ. Rips, and RasinskiKenneth (2000), The Psychology of Survey Response.Cambridge, UK: Cambridge University Press.
33.
WeijtersBert, CabooterElke, and SchillewaertNiels (2010), “The Effect of Rating Scale Format on Response Styles: The Number of Response Categories and Response Category Labels, ”International Journal of Research in Marketing, 27 (3), 236–47.
34.
WeijtersBert, GeuensMaggie, and SchillewaertNiels (2009), “The Proximity Effect: The Role of Inter-Item Distance on Reverse-Item Bias, ”International Journal of Research in Marketing, 26 (1), 2–12.
35.
WongNancy, RindfleischAric, and JamesE. Burroughs (2003), “Do Reverse-Worded Items Confound Measures in Cross-Cultural Consumer Research? The Case of the Material Values Scale, ”Journal of Consumer Research, 30 (June), 72–91.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
