Sage Journals: Discover world-class research

Abstract

Declining survey response rates concern researchers aiming to ensure study validity. This article tested the effectiveness of multiple pre-incentives on increasing survey response to the Millennium Cohort Study. Participants consisted of U.S. military service members and veterans, and were randomly assigned to receive a $2 bill, $5 gift card, magnet, Apple iPad^® lottery entry, or no pre-incentive. Participants who received the gift card or cash pre-incentive had the highest response rates and were significantly more likely to respond to the survey than those who did not receive a pre-incentive. There was no significant difference in survey response among the magnet or lottery entry groups compared to the no pre-incentive group. This study found that giving participants a monetary pre-incentive was an effective way to increase response rates, and thereby participant retention, in a hard-to-reach, highly mobile population, and re-engage participants who did not respond to a previous follow-up survey.

Get full access to this article

View all access options for this article.

References

Avdeyeva

O. A.

Matland

R. E.

. 2013. An experimental test of mail surveys as a tool for social inquiry in Russia. International Journal of Public Opinion Research 25:173–94.

Baker

D. G.

Nash

W. P.

Litz

B. T.

Geyer

M. A.

Risbrough

V. B.

Nievergelt

C. M.

O’Connor

D. T.

Larson

G. E.

Schork

N. J.

Vasterling

J. J.

Hammer

P. S.

Webb-Murphy

J. A.

MRS Team . 2012. Predictors of risk and resilience for posttraumatic stress disorder among ground combat Marines: Methods of the Marine Resiliency Study. Preventing Chronic Disease 9:E97.

Becker

Möser

Glauser

. 2019. Cash vs. vouchers vs. gifts in web surveys of a mature panel study—Main effects in a long-term incentives experiment across three panel waves. Social Science Research 81:221–34.

Brown

J. A.

Serrato

C. A.

Hugh

Kanter

M. H.

Spritzer

K. L.

Hays

R. D.

. 2016. Effect of a post-paid incentive on response rates to a web-based survey. Survey Practice 9:1–7.

Cantor

O’Hare

B. C.

O’Connor

K. S.

. 2008. Advances in telephone survey methodology. In The use of monetary incentives to reduce nonresponse in random digit dial telephone surveys, eds. Leposki

J. M.

Tucker

Brick

J. M.

de Leeuw

E. D.

Japec

Lavrakas

P. J.

Link

M. W.

Sangster

R. L.

, 471–98. Hoboken, NJ: John Wiley & Sons.

Centers for Disease Control and Prevention . 2013. 2012 National Health Interview Survey public use data release: NHIS survey description. Hyattsville, MD: National Center of Health Statistics. https://ftp.cdc.gov/pub/health_statistics/nchs/dataset_documentation/NHIS/2012/srvydesc.pdf (accessed April 6, 2018).

Centers for Disease Control and Prevention . 2022. National health and nutrition examination survey: Nhanes response rates and population totals. Atlanta, GA: Centers for Disease Control and Prevention. (https://wwwn.cdc.gov/nchs/nhanes/responserates.aspx (accessed March 22, 2022).

Church

A. H.

1993. Estimating the effect of incentives on mail survey response rates: A meta-analysis. Public Opinion Quarterly 57:62–79.

Crum-Cianflone

N. F.

Fairbank

J. A.

Marmar

C. R.

Schlenger

. 2014. The Millennium Cohort Family Study: A prospective evaluation of the health and well-being of military service members and their families. International Journal of Methods in Psychiatric Research 23:320–30.

10.

Deng

Y. D.

Hillygus

D. S.

Reiter

J. P.

Zheng

. 2013. Handling attrition in longitudinal studies: The case for refreshment samples. Statistical Science 28:238–56.

11.

Dillman

D. A.

Smyth

J. D.

Christian

L. M.

. 2014. Internet, phone, mail, and mixed-mode surveys: The tailored design method. New York: John Wiley & Sons.

12.

Dykema

Stevenson

Kniss

Kvale

González

Cautley

. 2012. Use of monetary and nonmonetary incentives to increase response rates among African Americans in the Wisconsin Pregnancy Risk Assessment Monitoring System. Maternal and Child Health Journal 16:785–91.

13.

Dykema

Jaques

Cyffka

Assad

Hammers

R. G.

Elver

Malecki

K. C.

Stevenson

. 2015. Effects of sequential prepaid incentives and envelope messaging in mail surveys. Public Opinion Quarterly 79:906–31.

14.

Galea

Tracy

. 2007. Participation rates in epidemiologic studies. Annals of Epidemiology 17:643–53.

15.

Göritz

A. S.

2008. The long-term effect of material incentives on participation in online panels. Field Methods 20:211–25.

16.

Gouldner

A. W.

1960. The norm of reciprocity: A preliminary statement. American Sociological Review 25:161–78.

17.

Gray

G. C.

Chesbrough

K. B.

Ryan

M. A. K.

Amoroso

Boyko

E. J.

Gackstetter

G. D.

Hooper

T. I.

Riddle

J. R.

Millennium Cohort Study Group . 2002. The Millennium Cohort Study: A 21-year prospective cohort study of 140,000 military personnel. Military Medicine 167:483–88.

18.

Griffis

S. E.

Goldsby

T. J.

Cooper

. 2003. Web‐based and mail surveys: A comparison of response, data, and cost. Journal of Business Logistics 24:237–58.

19.

Halbesleben

J. R. B.

Whitman

M. V.

. 2013. Evaluating survey quality in health services research: A decision framework for assessing nonresponse bias. Health Services Research 48:913–30.

20.

Keyes

K. M.

Rutherford

Popham

Martins

S. S.

Gray

. 2018. How healthy are survey respondents compared with the general population?: Using survey-linked death records to compare mortality outcomes. Epidemiology 29:299–307.

21.

Laurie

Smith

Scott

. 1999. Strategies for reducing nonresponse in a longitudinal panel survey. Journal of Official Statistics 15:269–82.

22.

Laurie

Lynn

. 2009. The use of respondent incentives on longitudinal surveys. Methodology of Longitudinal Surveys, ed. Lynn

, 205–33. Chichester, UK: John Wiley & Sons.

23.

Messer

B. L.

Dillman

D. A.

. 2011. Surveying the general public over the Internet using address-based sampling and mail contact procedures. Public Opinion Quarterly 75:429–57.

24.

Naifeh

J. A.

Capaldi

V. F.

Chu

King

A. J.

Koh

K. A.

Marx

B. P.

Montgomery

A. E.

O’Brien

R. W.

Sampson

N. A.

Stanley

I. H.

Tsai

Vogt

Ursano

R. J.

Stein

M. B.

Kessler

R. C.

. 2022. Prospective associations of military discharge characterization with post-active duty suicide attempts and homelessness: Results from the study to assess risk and resilience in servicemembers—Longitudinal Study (STARRS-LS). Military Medicine usac232. https://doi.org/10.1093/milmed/usac232

25.

Nederhof

A. J.

1983. The effects of material incentives in mail surveys: Two studies. Public Opinion Quarterly 47:103–11.

26.

Pforr

Blohm

Blom

A. G.

Erdel

Felderer

Fräßdorf

Hajek

Helmschrott

Kleinert

Koch

Krieger

Kroh

Martin

Saßenroth

Schmiedeberg

Trüdinger

E. M.

Rammstedt

. 2015. Are incentive effects on response rates and nonresponse bias in large-scale, face-to-face surveys generalizable to Germany? Evidence from ten experiments. Public Opinion Quarterly 79:740–68.

27.

Ryan

M. A. K.

Smith

T. C.

Smith

Amoroso

Boyko

E. J.

Gray

G. C.

Gackstetter

G. D.

Riddle

J. R.

Wells

T. S.

Gumbs

Corbeil

T. E.

Hooper

T. I.

. 2007. Millennium Cohort: Enrollment begins a 21-year contribution to understanding the impact of military service. Journal of Clinical Epidemiology 60:181–91.

28.

SAS Institute Inc . 2012. Sas Software (Version 9.3). Cary, NC.

29.

Shettle

Mooney

. 1999. Monetary incentives in U.S. government surveys. Journal of Official Statistics 15:231–50.

30.

Singer

. 2013. The use and effects of incentives in surveys. The ANNALS of the American Academy of Political and Social Science 645:112–41.

31.

VanGeest

J. B.

Wynia

M. K.

Cummins

D. S.

Wilson

I. B.

. 2001. Effects of different monetary incentives on the return rate of a national mail survey of physicians. Medical Care 39:197–201.

32.

Warriner

Goyder

Gjertsen

Hohner

McSpurren

. 1996. Charities, no; Lotteries, no; Cash, yes: Main effects and interactions in a Canadian incentives experiment. Public Opinion Quarterly 60:542–62.

33.

Young

A. F.

Powers

J. R.

Bell

S. L.

. 2006. Attrition in longitudinal studies: Who do you lose? Australian and New Zealand Journal of Public Health 30:353–61.

34.

Zagorsky

J. L.

Rhoton

. 2008. The effects of promised monetary incentives on attrition in a long-term panel survey. Public Opinion Quarterly 72:502–13.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.24 MB

Pre-incentive Efficacy in Survey Response Rates in a Large Prospective Military Cohort

Abstract

Get full access to this article

References

Supplementary Material