Daily Compensation Can Improve College Students’ Participation and Retention Rates in Daily Report Studies

Abstract

In longitudinal daily report research, it is challenging to maintain participation with college student samples due to the time and mental energy required. Small monetary incentives can assuage this; thus, the goal of this study was to determine whether incentive distribution method—via (1) the total compensation at the end of the study period, (2) daily compensation that increases with subsequent surveys, or (3) the same steady compensation each day—leads to different completion rates across five consecutive daily surveys. Both steady and increasing compensation groups were more likely to opt-in to the study, while the steady compensation group was more likely to complete the Day 1 survey. Over 5 days, the steady group had a sharper decrease in participation but had a rebound in participation toward the end of the study. Recommendations and rationale for using a daily steady compensation approach with daily report methodology with emerging adults are discussed.

Keywords

education methodology longitudinal daily reports emerging adults

Get full access to this article

View all access options for this article.

References

Blau

P. M.

(1964). Power and exchange in social life. New York, NY: John Wiley.

Bolger

Davis

Rafaeli

(2003). Diary methods: Capturing life as it is lived. Annual Review of Psychology, 54, 579–616. doi:10.1146/annurev.psych.54.101601.145030

Bosnjak

Tuten

T. L.

(2003). Prepaid and promised incentives in web surveys. Social Science Computer Review, 21, 208–217. doi:10.1177/0894439303021002006

Busby

D. M.

Yoshida

(2015). Challenges with online research for couples and families: Evaluating nonrespondents and the differential impact of incentives. Journal of Child and Family Studies, 24, 505–513. doi:10.1007/s10826-013-9863-6

Church

A. H.

(1993). Estimating the effect of incentives on mail survey response rates: A meta-analysis. Public Opinion Quarterly, 57, 62–79.

Cranford

J. A.

McCabe

S. E.

Boyd

C. J.

Slayden

Reed

M. B.

Ketchie

J. M.

… Scott

M. S.

(2008). Reasons for nonresponse in a web-based survey of alcohol involvement among first-year college students. Addictive Behaviors, 33, 206–210. doi:10.1016/j.addbeh.2007.07.008

de Looze

ter Bogt

T. F.

Vollebergh

W. A.

(2013). Explaining educational differences in adolescent substance use and sexual activity the role of conceptions and expectations of adulthood. Emerging Adulthood, 1, 175–184. doi:10.1177/2167696812471942

Dey

E. L.

(1997). Working with low survey response rates: The efficacy of weighting adjustments. Research in Higher Education, 38, 215–227.

Dillman

D. A.

(2000). The role of behavioral survey methodologists in national statistical agencies. International Statistical Review, 68, 200–213. doi:10.1111/j.1751-5823.2000.tb00323.x

10.

Eckenrode

Bolger

(1997). Daily and within-day event measurement. In Cohen

Kessler

R. C.

(Eds.), Measuring stress: A guide for health and social scientists (pp. 80–101). London, England: Oxford University Press.

11.

Fuligni

A. J.

Telzer

E. H.

Bower

Cole

S. W.

Kiang

Irwin

M. R.

(2009). A preliminary study of daily interpersonal stress and C-reactive protein levels among adolescents from Latin American and European backgrounds. Psychosomatic Medicine, 71, 329–333. doi:10.1097/PSY.0b013e3181921b1f

12.

Göritz

A. S.

(2014). Determinants of the starting rate and the completion rate in online panel studies. In Callegaro

Baker

Bethlehem

Göritz

A. S.

Krosnick

J. A.

Lavrakas

P. J.

(Eds.), Online panel research (pp. 154–170). New York, NY: John Wiley.

13.

Gravlee

C. C.

Kennedy

D. P.

Godoy

Leonard

W. R.

(2009). Methods for collecting panel data: What can cultural anthropology learn from other disciplines. Journal of Anthropological Research, 65, 453–483. doi:10.3998/jar.0521004.0065.304

14.

Helgeson

J. G.

Voss

K. E.

Terpening

W. D.

(2002). Determinants of mail-survey response: Survey design factors and respondent factors. Psychology and Marketing, 19, 303–328. doi:10.1002/mar.1054

15.

Henker

Whalen

C. K.

Jamner

L. D.

Delfino

R. J.

(2002). Anxiety, affect, and activity in teenagers: Monitoring daily life with electronic diaries. Journal of the American Academy of Child and Adolescent Psychiatry, 41, 660–670. doi:10.1097/00004583-200206000-00005

16.

Howard

A. L.

(2015). Leveraging time-varying covariates to test within-and between-person effects and interactions in the multilevel linear model. Emerging Adulthood, 3, 400–412. doi:10.1177/2167696815592726

17.

Howard

K. I.

Krause

M. S.

Orlinsky

D. E.

(1986). The attrition dilemma: Toward a new strategy for psychotherapy research. Journal of Consulting and Clinical Psychology, 54, 106–110. doi:10.1037/0022-006X.54.1.106

18.

Kraut

Olson

Banaji

Bruckman

Cohen

Couper

(2004). Psychological research online: Report of board of scientific affairs’ advisory group on the conduct of research on the internet. American Psychologist, 59, 105–117. doi:10.1037/0003-066X.59.2.105

19.

Latterman

Merz

J. F.

(2001). How much are subjects paid to participate in research? American Journal of Bioethics, 1, 45–46.

20.

McCoy

T. P.

E. H.

Blocker

J. N.

Champion

Rhodes

S. D.

Wagoner

K. G.

… Wolfson

(2009). Attrition bias in a US internet survey of alcohol use among college freshmen. Journal of Studies on Alcohol and Drugs, 70, 606–614. doi:10.15288/jsad.2009.70.606

21.

Miller

Perlman

Brehm

(2007). Intimate relationships. New York, NY: McGraw-Hill College.

22.

Nishina

(2012). Adolescent daily and general maladjustment: Is there reactivity to daily repeated measures methodologies? Child Development, 83, 405–412. doi:10.1111/j.1467-8624.2011.01718.x

23.

Oesterle

Hawkins

J. D.

Hill

K. G.

Bailey

J. A.

(2010). Men’s and women’s pathways to adulthood and their adolescent precursors. Journal of Marriage and Family, 72, 1436–1453. doi:10.1111/j.1741–3737.2010.00775.x

24.

Parra

L. A.

Benibgui

Helm

J. L.

Hastings

P. D.

(2016). Minority stress predicts depression in lesbian, gay, and bisexual emerging adults via elevated diurnal cortisol. Emerging Adulthood, 4, 365–372. doi:10.1177/2167696815626822

25.

Pike

G. R.

(2007). Adjusting for nonresponse in surveys. Higher Education Handbook of Theory and Research, XXII, 411–449. doi:10.1007/978-1-4020-5666-6_8

26.

Porter

S. R.

(2004). Raising response rates: What works? New Directions for Institutional Research, 2004, 5–21. doi:10.1002/ir.97

27.

Porter

S. R.

Umbach

(2006). Student survey response rates across institutions: Why do they vary? Research in Higher Education, 47, 229–247. doi:10.1007/s11162-005-8887-1

28.

Porter

S. R.

Whitcomb

M. E.

(2005). Non-response in student surveys: The role of demographics, engagement and personality. Research in Higher Education, 46, 127–152. doi:10.1007/s11162-004-1597-2

29.

Ripley

E. B. D.

Macrina

Markowitz

Gennings

(2010). Why do we pay? A national survey of investigators and IRB chairpersons. Journal of Empirical Research on Human Research Ethics, 5, 43–56. doi:10.1525/jer.2010.5.3.43

30.

Sax

L. J.

Gilmartin

S. K.

Lee

J. J.

Hagedorn

L. S.

(2008). Using web surveys to reach community college students: An analysis of response rates and response bias. Community College Journal of Research and Practice, 32, 712–729. doi:10.1080/10668920802000423

31.

Schneider

(2006). In the moment: The benefits of the experience sampling method. In Pitt-Catsouphes

Kossek

E. E.

Sweet

(Eds.), The work and family hand-book: Multi-disciplinary perspectives, methods, and approaches (pp. 469–488). Mahwah, NJ: Lawrence Erlbaum.

32.

Swanson

J. A.

(2016). Trends in literature about emerging adulthood: Review of empirical studies. Emerging Adulthood, 4, 1–12. doi:10.1177/2167696816630468

33.

Syed

Azmitia

(2009). Longitudinal trajectories of ethnic identity during the college years. Journal of Research on Adolescence, 19, 601–624. doi:10.1111/j.1532-7795.2009.00609.x

34.

Syed

Mitchell

L. L.

(2013). Race, ethnicity, and emerging adulthood: Retrospect and prospects. Emerging Adulthood, 1, 83–95.

35.

Szelényi

Bryant

A. N.

Lindholm

J. A.

(2005). What money can buy: Examining the effects of prepaid monetary incentives on survey response rates among college students. Educational Research and Evaluation, 11, 385–404. doi:10.1080/13803610500110174

36.

Terenzini

P. T.

(2010). Assessment with open eyes: Pitfalls in studying student outcomes. New Directions for Institutional Research, 2010, 29–46. doi: 10.1002/ir.329

37.

Thomas

Azmitia

(2016). Tapping into the app updating the experience sampling method for the 21st century. Emerging Adulthood, 4, 60–67. doi:10.1177/2167696815618489

38.

U.S. Department of Education, National Center for Education Statistics. (2017). The Condition of Education 2017 (NCES 2017-144).

39.

Umbach

(2005). Getting back to the basics of survey research. New Directions for Institutional Research, 2005, 91–100. doi:10.1002/ir.157

40.

van Roekel

Scholte

R. H. J.

Engels

R. C. M. E.

Verhagen

(2016). Loneliness in the daily lives of young adults: Testing a socio-cognitive model. European Journal of Personality, 30, 19–30. doi:10.1002/per.2028

41.

Warnecke

R. B.

Parsons

J. A.

(2001). Longitudinal research: Panel retention. In Smelser

N. J.

Baltes

P. B.

(Eds.), International encyclopedia of the social & behavioral sciences (pp. 9067–9071). Oxford, England: Pergamon. doi:10.1016/B0-08-043076-7/00749-X

42.

White

J. M.

Klein

D. M.

(2007). Family theories (3rd ed.). Thousand Oaks, CA: Sage.

43.

Yip

Fuligni

A. J.

(2002). Daily variation in ethnic identity, ethnic behaviors, and psychological well-being among American adolescents of Chinese descent. Child Development, 73, 1557–1572.