Sage Journals: Discover world-class research

Abstract

The presentation of survey requests represents an easily modifiable feature of survey communications that can in some contexts affect response propensities. Here, we examine how two features: the framing of the participation request (informed by prospect theory) and the inclusion of targeted appeals based on demographic background (age or electoral district), affect participation rates in the 2021 Icelandic National Election Study, a mixed-mode cross-sectional survey. We find that these features generally fail to affect response propensities and sample composition. However, framed requests produced marginally higher response rates for a subset of the sample that was invited to complete the survey online. This suggests that modifying the presentation of the survey request may be less effective in cross-sectional surveys than in longitudinal ones, where more information is available to inform the content of targeted messages.

Get full access to this article

View all access options for this article.

References

American Association for Public Opinion Research (AAPOR) . 2016. Standard definitions: Final dispositions of case codes and outcome rates for surveys. 9th ed. Chicago: American Association for Public Opinion Research. https://www.aapor.org/AAPOR_Main/media/publications/Standard-Definitions20169theditionfinal.pdf

Bradburn

N. M.

1979. Respondent burden. In Health survey research methods: Second biennial conference, eds. Reeder

, 35–40. Washington, DC: U.S. Government Printing Office.

Christensen

A. I.

Lynn

Tolstrup

J. S.

. 2019. Can targeted cover letters improve participation in health surveys? Results from a randomized controlled trial. BMC Medical Research Methodology 19:1–8.

Cleary

Balmer

. 2015. Fit for purpose? The impact of between-wave engagement strategies on response to a longitudinal survey. International Journal of Market Research 57:533–54.

Dillman

D. A.

Smyth

J. D.

Christian

L. M.

. 2014. Internet, phone, mail and mixed-mode surveys. 4th ed. Hoboken, NJ: Wiley.

Fumagalli

Laurie

Lynn

. 2013. Experiments with methods to reduce attrition in longitudinal surveys. Journal of the Royal Statistical Society. Series A: Statistics in Society 176:499–519.

Groves

R. M.

Cialdini

R. B.

Couper

M. P.

. 1992. Understanding the decision to participate in a survey. Public Opinion Quarterly 56:475–95.

Groves

R. M.

Couper

M. P.

. 1998. Nonresponse in household interview surveys. New York: John Wiley & Sons, Inc.

Groves

R. M.

Singer

Corning

. 2000. Leverage-saliency theory of survey participation. Public Opinion Quarterly 64:299–308.

10.

Kahneman

Tversky

. 1979. Prospect theory: An analysis of decision under risk. Econometrica 47:263.

11.

Kahneman

Tversky

. 1984. Choices, values, and frames. American Psychologist 39:341–50.

12.

Kreuter

Sakshaug

J. W.

Tourangeau

. 2016. The framing of the record linkage consent question. International Journal of Public Opinion Research 28:142–52.

13.

Lewis

Gorsak

Yount

. 2019. An automated refusal conversion strategy for web surveys. Field Methods 31:309–27.

14.

Little

R. J.

Vartivarian

. 2005. Does weighting for nonresponse increase the variance of survey means? Survey Methodology 31:161–68.

15.

Lynn

2016. Targeted appeals for participation in letters to panel survey members. Public Opinion Quarterly 80:771–82.

16.

Lynn

2017. From standardised to targeted survey procedures for tackling non-response and attrition. Survey Research Methods 11:93–103.

17.

Lynn

2019. Applying prospect theory to participation in a CAPI/web panel survey. Public Opinion Quarterly 83:559–67.

18.

Önnudóttir

E. H.

Helgason

A. F.

Hardarson

Ó. T.

Thórisdóttir

. 2021. Electoral politics in crisis after the Great Recession. London: Routledge.

19.

R Core Team . 2021. R: A language and environment for statistical computing (4.1.2). R Foundation for Statistical Computing. http://www.R-project.org/

20.

Sakshaug

J. W.

Stegmaier

Trappmann

Kreuter

. 2019. Does benefit framing improve record linkage consent rates? A survey experiment. Survey Research Methods 13:289–304.

21.

Sakshaug

J. W.

Tutz

Kreuter

. 2013. Placement, wording, and interviewers: Identifying correlates of consent to link survey and administrative data. Survey Research Methods 7:133–44.

22.

Sakshaug

J. W.

Vicari

B. J.

. 2018. Obtaining record linkage consent from establishments: The impact of question placement on consent rates and bias. Journal of Survey Statistics and Methodology 6:46–71.

23.

Tajfel

Turner

. 1986. The social identity theory of intergroup behaviour. In Psychology of intergroup relations, eds. Worchel

Austin

W. G.

, 7–24. Chicago: Nelson-Hall.

24.

Tourangeau

. 2009. The framing of the survey request and panel attrition. Public Opinion Quarterly 73:338–48.

25.

Wagner

J. R.

2008. Adaptive survey design to reduce nonresponse bias. Ph.D. dissertation, University of Michigan, Ann Arbor. https://deepblue.lib.umich.edu/bitstream/handle/2027.42/60831/jameswag_1.pdf?sequence=1

26.

Zhang

Wagner

. 2022. The additional effects of adaptive survey design beyond post-survey adjustment: An experimental evaluation. Sociological Methods & Research First published online: 1–34.

The Effects of Framing the Survey Request and Using Targeted Appeals on Participation in Cross-sectional Surveys

Abstract

Get full access to this article

References