Individual-Level Cultural Factors and Use of Survey Response Styles Among Latino Survey Respondents

Abstract

Acquiescent (ARS) and extreme response styles (ERS) can have detrimental effects on survey data and, for unknown reasons, are more frequently used by Latino than non-Latino white respondents. This exploratory study examined the influence of culture on these response styles by investigating their associations with individual-level cultural factors and ARS and ERS among 1,296 Mexican American, Puerto Rican, and Cuban American telephone survey respondents. Principal components representing stronger endorsement of marianismo/machismo and social attentiveness (simpatía, personalismo, respect for elders, value for sincerity, collectivism, individualism) were associated with higher ARS and ERS, while higher trust in strangers and more limited health literacy were associated with lower ERS. Findings from this study will enable survey designers to better anticipate ARS and ERS in surveys with Latino populations and, in turn, guide the selection of data collection and analysis methods to mitigate measurement error in the presence of these response styles.

Keywords

surveys culture response styles measurement error Hispanic/Latino

Get full access to this article

View all access options for this article.

References

Altemeyer

(2002). Dogmatic behavior among students: Testing a new measure of dogmatism. The Journal of Social Psychology, 142(6), 713–721.

American Association for Public Opinion Research. (2016). Standard definitions: Final dispositions of case codes and outcome rates for surveys. https://aapor.org/standards-and-ethics/standard-definitions/

Arciniega

G. M.

Anderson

T. C.

Tovar-Blank

Z. G.

Tracey

T. J. G.

(2008). Toward a fuller conception of machismo: Development of a traditional machismo and caballerismo scale. Journal of Counseling Psychology, 55(1), 19–33.

Chen

Lee

S. Y.

Stevenson

H. W.

(1995). Response style and cross-cultural comparisons of rating scales among East Asian and North American students. Psychological Science, 6(3), 170–175.

Chew

L. D.

Bradley

K. A.

Boyko

E. J.

(2004). Brief questions to identify patients with inadequate health literacy. Family Medicine, 36(8), 588–594.

Cohen

Kamarck

Mermelstein

(1983). A global measure of perceived stress. Journal of Health and Social Behavior, 24, 385–396.

Couch

Keniston

(1960). Yeasayers and naysayers: Agreeing response set as a personality variable. Journal of Abnormal and Social Psychology, 60(2), 151–174.

Cronbach

L. J.

(1946). Response sets and test validity. Educational and Psychological Measurement, 6(4), 475–494.

Crowson

H. M.

DeBacker

T. K.

Davis

K. A.

(2008). The DOG Scale: A valid measure of dogmatism? Journal of Individual Differences, 29(1), 17–24.

10.

Cuellar

Arnold

González

(1995). Cognitive referents of acculturation: Assessment of cultural constructs in Mexican Americans. Journal of Community Psychology, 23(4), 339–356.

11.

Cuellar

Arnold

Maldonado

(1995). Acculturation rating scale for Mexican Americans-II: A revision of the original ARSMA scale. Hispanic Journal of Behavioral Sciences, 17(3), 275–304.

12.

Davis

R. E.

Johnson

T. P.

Lee

Werner

(2019). Why do Latino survey respondents acquiesce? Respondent and interviewer characteristics as determinants of cultural patterns of acquiescence among Latino survey respondents. Cross-Cultural Research, 53(1), 87–115.

13.

Davis

R. E.

Lee

Johnson

T. P.

Rothschild

S. K.

(2019a). Development of a bidimensional simpatía scale for use with Mexican American, Puerto Rican, and Cuban American adults. Nursing Research, 68(5), 348–357.

14.

Davis

R. E.

Lee

Johnson

T. P.

Rothschild

S. K.

(2019b). Measuring the elusive construct of personalismo among Mexican American, Puerto Rican, and Cuban American adults. Hispanic Journal of Behavioral Sciences, 41(1), 103–121.

15.

Davis

R. E.

Resnicow

Couper

M. P.

(2011). Survey response styles, acculturation, and culture among a sample of Mexican American adults. Journal of Cross-Cultural Psychology, 42(7), 1219–1236.

16.

de Jong

M. G.

Steenkamp

J.-B. E. M.

Fox

J.-P.

Baumgartner

. (2008). Using item response theory to measure extreme response style in marketing research: A global investigation. Journal of Marketing Research, 45, 104–115.

17.

Flores

(2017, September 18). How the U.S. Hispanic population is changing. FactTank News in the Numbers. http://www.pewresearch.org/fact-tank/2017/09/18/how-the-u-s-hispanic-population-is-changing/

18.

Guo

Spina

(2019). Cross-cultural variations in extreme rejecting and extreme affirming response styles. Journal of Cross-Cultural Psychology, 50(8), 955–971.

19.

Haberstroh

Oyserman

Schwarz

Kühnen

L. J.

(2002). Is the interdependent self more sensitive to question context than the independent self? Self-construal and the observation of conversational norms. Journal of Experimental Social Psychology, 38, 323–329.

20.

Harzing

A.-W.

(2006). Response styles in cross-national survey research: A 26-country study. International Journal of Cross Cultural Management, 6(2), 243–266.

21.

Bartram

Inceoglu

van de Vijver

F. J. R.

(2014). Response styles and personality traits: A multilevel analysis. Journal of Cross-Cultural Psychology, 45(7), 1028–1045.

22.

Hoffmann

Mai

Cristescu

(2013). Do culture-dependent response styles distort substantial relationships? International Business Review, 22, 814–827.

23.

Hofstede

(2001). Culture’s consequences (2nd ed.). Sage.

24.

Hui

C. H.

Triandis

H. C.

(1989). Effects of culture and response format on extreme response style. Journal of Cross-Cultural Psychology, 20(3), 296–309.

25.

Javeline

(1999). Response effects in polite cultures: A test of acquiescence in Kazakhstan. Public Opinion Quarterly, 63, 1–28.

26.

L. J.

Schwarz

Nisbett

R. E.

(2000). Culture, autobiographical memory, and behavioral frequency reports: Measurement issues in cross-cultural studies. Personality and Social Psychology Bulletin, 26, 585–593.

27.

Johnson

Kulesa

Cho

Y. I.

Shavitt

(2005). The relation between culture and response styles: Evidence from 19 countries. Journal of Cross-Cultural Psychology, 36(2), 264–277.

28.

Jones

Marks

Ramirez

Ríos-Vargas

(2021, August 12). 2020 Census illuminates racial and ethnic composition of the country. https://www.census.gov/library/stories/2021/08/improved-race-ethnicity-measures-reveal-united-states-population-much-more-multiracial.html

29.

Kieruj

N. D.

Moors

(2013). Response style behavior: Question format dependent or personal style? Quality & Quantity, 47, 193–211.

30.

Krautz

Hoffmann

(2019). Cross-cultural application of a practice-oriented acquiescence measure. International Marketing Review, 36(3), 391–415.

31.

Kulis

Marsiglia

F. F.

Hurdle

(2003). Gender identity, ethnicity, acculturation, and drug use: Exploring differences among adolescents in the Southwest. Journal of Community Psychology, 31(2), 167–188.

32.

Kutner

Greenberg

Jin

Paulsen

(2006). The health literacy of America’s adults: Results from the 2003 National Assessment of Adult Literacy (NCES 2006–483). https://nces.ed.gov/pubs2006/2006483.pdf

33.

Lechner

C. M.

Partsch

M. V.

Danner

Rammstedt

(2019). Individual, situational, and cultural correlates of acquiescent responding: Towards a unified conceptual framework. British Journal of Mathematical and Statistical Psychology, 72(3), 426–446.

34.

Lee

Alvarado-Leiton

Davis

Johnson

T. P.

(2022). Developing a short screener for acquiescent respondents. Research in Social and Administrative Pharmacy, 18(5), 2817–2829.

35.

Lee

J. W.

Jones

P. S.

Mineyama

Zhang

X. E

. (2002). Cultural differences in responses to a Likert scale. Research in Nursing and Health, 25, 295–306.

36.

Marín

Gamba

R. J.

Marín

B. V.

(1992). Extreme response style and acquiescence among Hispanics: The role of acculturation and education. Journal of Cross-Cultural Psychology, 23(4), 498–509.

37.

Marín

VanOss Marín

(1991). Research with Hispanic populations (Vol. 23). Sage.

38.

McNaughton

C. D.

Cavanaugh

K. L.

Kripalani

Rothman

R. L.

Wallston

K. A.

(2015). Validation of a short, 3-item version of the Subjective Numeracy Scale. Medical decision making, 35(8), 932–936.

39.

Meisenberg

Williams

(2008). Are acquiescent and extreme response styles related to low intelligence and education? Personality and Individual Differences, 44(7), 1539–1550.

40.

Moors

(2010). Ranking the ratings: A latent-class regression model to control for overall agreement in opinion research. International Journal of Public Opinion Research, 22(1), 93–119.

41.

Narayan

Krosnick

J. A.

(1996). Education moderates some response effects in attitude measurement. Public Opinion Quarterly, 60(1), 58–88.

42.

National Alliance for Hispanic Health. (2001). A primer for cultural proficiency: Towards quality health services for Hispanics. Estrella Press.

43.

Raghunathan

T. E.

Lepkowski

J. M.

Van Hoewyk

Solenberger

(2001). A multivariate technique for multiply imputing missing values using a sequence of regression models. Survey Methodology, 27(1), 85–96.

44.

Rammstedt

Danner

Bosnjak

(2017). Acquiescence response styles: A multilevel model explaining individual-level and country-level differences. Personality and Individual Differences, 107, 190–194. https://doi.org/10.1016/j.paid.2016.11.038

45.

R Core Team. (2020). R: A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org/

46.

Rosenberg

(1965). Society and the adolescent self-image. Princeton University Press.

47.

Ross

C. E.

Mirowsky

(1984). Socially-desirable response and acquiescence in a cross-cultural survey of mental health. Journal of Health and Social Behavior, 25(2), 189–197.

48.

Saris

W. E.

Revilla

Krosnick

J. A.

Schaeffer

E. M.

(2010). Comparing questions with agree/disagree response options to questions with item-specific response options. Survey Research Methods, 4(1), 61–79.

49.

Schmitz

M. F.

Baer

J. C.

(2001). The vicissitudes of measurement: A confirmatory factor analysis of the emotional autonomy scale. Child Development, 72(1), 207–219.

50.

Singh

Coyne

L. S.

Wallace

L. S.

(2015). Brief screening items to identify Spanish-speaking adults with limited health literacy and numeracy skills. BMC Health Services Research, 15, 374.

51.

Smith

P. B.

(2004). Acquiescent response bias as an aspect of cultural communication style. Journal of Cross-Cultural Psychology, 35(1), 50–61.

52.

Smith

P. B.

(2011). Communication styles as dimensions of national culture. Journal of Cross-Cultural Psychology, 42(2), 216–233.

53.

Smith

P. B.

Fischer

(2008). Acquiescence, extreme response bias and culture: A multilevel analysis. In van de Vijver

F. J. R.

van Hemert

D. A.

Poortinga

Y. H.

(Eds.), Multilevel analysis of individuals and cultures (pp. 285–314). Lawrence Erlbaum Associates.

54.

Smith

P. B.

Vignoles

V. L.

Becker

Owe

Easterbrook

M. J.

Brown

Bourguignon

Garðarsdóttir

R. B.

Kreuzbauer

Cendales Ayala

Yuki

Zhang

Chobthamkit

Jaafar

J. L.

Fischer

Milfont

T. L.

Gavreliuc

Baguma

, . . . Harb

(2016). Individual and culture-level components of survey response styles: A multi-level analysis using cultural models of selfhood. International Journal of Psychology, 51(6), 453–463.

55.

Steenkamp

J.-B. E. M.

Burgess

S. M.

(2002). Optimum stimulation level and exploratory consumer behavior in an emerging consumer market. International Journal of Research in Marketing, 19(2), 131–150.

56.

Stevens

E. P.

(1973). Marianismo: The other face of machismo in Latin America. In Pescatello

(Ed.), Female and male in Latin America: Essays (pp. 89–101). University of Pittsburgh Press.

57.

Triandis

H. C.

(1972). The analysis of subjective culture. John Wiley & Sons, Inc.

58.

Triandis

H. C.

(1995). Individualism and collectivism. Westview Press.

59.

Triandis

H. C.

Gelfand

M. J.

(1998). Converging measurement of horizontal and vertical individualism and collectivism. Journal of Personality and Social Psychology, 74, 118–128.

60.

Triandis

H. C.

Marín

Lisansky

Betancourt

(1984). Simpatía as a cultural script of Hispanics. Journal of Personality and Social Psychology, 47(6), 1363–1375.

61.

van Herk

Poortinga

Y. H.

Verhallen

T. M. M

. (2004). Response styles in rating scales: Evidence of method bias in data from six EU countries. Journal of Cross-Cultural Psychology, 35(3), 346–360.

62.

Van Vaerenbergh

Thomas

T. D

. (2013). Response styles in survey research: A literature review of antecedents, consequences, and remedies. International Journal of Public Opinion Research, 25(2), 195–217.

63.

Warnecke

R. B.

Johnson

T. P.

Chávez

Sudman

O’Rourke

D. P.

Lacey

Horm

(1997). Improving question wording in surveys of culturally diverse populations. Annals of Epidemiology, 7(5), 334–342.

64.

Weech-Maldonado

Elliott

M. N.

Oluwole

Schiller

K. C.

Hays

R. D.

(2008). Survey response style and differential use of CAHPS rating scales by Hispanics. Medical Care, 46(9), 963–968.

65.

Weijters

Geuens

Schillewaert

(2010). The stability of individual response styles. Psychological Methods, 15(1), 96–110.

66.

Wong

Rindfleisch

Burroughs

J. E.

(2003). Do reverse-worded items confound measures in cross-cultural consumer research? The case of the material values scale. Journal of Consumer Research, 30, 72–91.

67.

World Values Survey Association. (2005). 2005-2006 World Values Survey. http://www.worldvaluessurvey.org/wvs/articles/folder_published/survey_2005

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.06 MB