The Effect of Differential Incentives on Attrition Bias

Abstract

Respondent incentives are widely used to increase response rates, but their effect on nonresponse bias has not been researched as much. To contribute to the research, we analyze an incentive experiment embedded within the third wave of the German household panel survey “Panel Labor Market and Social Security” conducted by the German Institute for Employment Research. Our question is whether attrition bias differs in two incentive plans. In particular, we want to study whether an unconditional €10 cash incentive yields less attrition bias in self-reported labor income and other sociodemographics than a conditional lottery ticket incentive. We find that unconditional cash incentives are more effective than conditional lottery tickets in reducing attrition bias in income and several sociodemographic variables.

Get full access to this article

View all access options for this article.

References

Beste

2011. Selektivitätsprozesse bei der Verknüpfung von Befragungs—mit Prozessdaten. Record Linkage mit Daten des Panels “Arbeitsmarkt und soziale Sicherung” und administrativen Daten der Bundesagentur für Arbeit. FDZ. Methodische Aspekte zu Arbeitsmarktdaten [Selectivities in the linkage of survey and process data. Record linkage with data from the panel labour market and social security and the administrative records of the federal employment agency]. Methods report. http://doku.iab.de/fdz/reporte/2011/MR_09-11.pdf (accessed June 30, 2017).

Büngeler

Gensicke

Hartmann

Jäckle

Tschersich

. 2010. FDZ- Methodenreport 10/2010. IAB-Haushaltspanel im Niedrigeinkommensbereich: Welle 3 (2008/2009) [IAB-household panel of those with low income: Wave 3 (2008/2009)]. Forschungsdatenzentrum der Bundesagentur für Arbeit im Institut für Arbeitsmarkt-und Berufsforschung. Methods. http://doku.iab.de/fdz/reporte/2010/MR_10-10.pdf (accessed June 30, 2017).

Cantor

O’Hare

O’Connor

. 2008. The use of monetary incentives to reduce non-response in random digit dial telephone surveys. In Advances in telephone survey methodology, eds. Lepowski

J. M.

Tucker

Brick

J. M.

de Leeuw

E. D.

Japec

Lavrakas

P. J.

Link

M. W.

Sangster

R. L.

, 471–98. New York: Wiley.

Church

A. H.

1993. Estimating the effect of incentives on mail survey response rates: A meta-analysis. Public Opinion Quarterly 57:62–79.

Dillman

D. A.

Smyth

J. D.

Christian

L. M.

. 2014. Internet, phone, mail and mixed-mode surveys: The tailored design method, 4th ed. New York: Wiley.

Groves

R. M.

Couper

M. P.

Presser

Singer

Tourangeau

Acosta

G. P.

Nelson

. 2006. Experiments in producing nonresponse bias. Public Opinion Quarterly 70:720–36.

Groves

R. M.

Peytcheva

. 2008. The impact of nonresponse rates on nonresponse bias. A meta-analysis. Public Opinion Quarterly 77:167–89.

Groves

R. M.

Singer

Corning

. 2000. Leverage-saliency theory of survey participation—Description and an illustration. Public Opinion Quarterly 64:299–308.

Jacobebbinghaus

Seth

. 2007. The German integrated employment biographies sample IEBS. Schmollers Jahrbuch. Zeitschrift für Wirtschafts- und Sozialwissenschaften 127:335–42.

10.

James

J. M.

Bolstein

. 1990. The effect of monetary incentives and follow-up mailings on the response rate and response quality in mail surveys. Public Opinion Quarterly 54:346–61.

11.

Laurie

Lynn

. 2009. The use of respondent incentives on longitudinal surveys. In Methodology of longitudinal surveys, ed. Lynn

, 205–33. New York: John Wiley.

12.

Mack

Huggins

Keathley

Sundukchi

. 1998. Do monetary incentives improve response rates in the survey of income and program participation? In Proceedings of the Survey Research Methods Section, ed. American Statistical Association, 529–34. Baltimore: American Statistical Association.

13.

Mercer

Caporaso

Cantor

Townsend

. 2015. How much gets you how much? Monetary incentives and response rates in household surveys. Public Opinion Quarterly 79:105–29.

14.

Philipson

1997. Data markets and the production of surveys. The Review of Economic Studies 64:47–72.

15.

Sakshaug

J. W.

Kreuter

. 2012. Assessing the magnitude of non-consent biases in linked survey and administrative data. Survey Research Methods 6:113–22.

16.

Schenker

Gentleman

J. F.

. 2001. On judging the significance of differences by examining the overlap between confidence intervals. The American Statistician 55:182–86.

17.

Singer

2002. The use of incentives to reduce nonresponse in household surveys. In Survey onresponse, eds. Groves

R. M.

Dillman

D. A.

Eltinge

J. L.

Little

R. J. A.

, 163–77. New York: John Wiley.

18.

Singer

Groves

R. M.

Corning

A. D.

. 1999. Differential incentives: Beliefs about practices, perceptions of equity, and effects on survey participation. Public Opinion Quarterly 63:251–60.

19.

Singer

van Hoewyk

Gebler

Raghunathan

McGonagle

. 1999. The effect of incentives on response rates in interviewer-mediated surveys. Journal of Official Statistics 15:217–30.

20.

Singer

. 2013. The use and effects of incentives in surveys. The Annals of the American Academy of Political and Social Science 645:112–41.

21.

Toepoel

2012. Effects of incentives in surveys. In Handbook of survey methodology for the social sciences, ed. Gideon

, 209–23. New York: Springer.

22.

Trappmann

Christoph

Achatz

Wenzig

Müller

Gebhardt

. 2009. Design and stratification of PASS: A new panel study on research on long-term unemployment. IAB discussion paper, Institut für Arbeitsmarkt-und Berufsforschung (IAB), Nürnberg, Germany.

23.

Willimack

D. K.

Schuman

Pennell

B.-E.

Lepkowski

J. M.

. 1995. Effects of a prepaid nonmonetary incentive on response rates and response quality in a face-to-face survey. Public Opinion Quarterly 59:78–92.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.21 MB