In longitudinal daily report research, it is challenging to maintain participation with college student samples due to the time and mental energy required. Small monetary incentives can assuage this; thus, the goal of this study was to determine whether incentive distribution method—via (1) the total compensation at the end of the study period, (2) daily compensation that increases with subsequent surveys, or (3) the same steady compensation each day—leads to different completion rates across five consecutive daily surveys. Both steady and increasing compensation groups were more likely to opt-in to the study, while the steady compensation group was more likely to complete the Day 1 survey. Over 5 days, the steady group had a sharper decrease in participation but had a rebound in participation toward the end of the study. Recommendations and rationale for using a daily steady compensation approach with daily report methodology with emerging adults are discussed.
BlauP. M. (1964). Power and exchange in social life. New York, NY: John Wiley.
2.
BolgerN.DavisA.RafaeliE. (2003). Diary methods: Capturing life as it is lived. Annual Review of Psychology, 54, 579–616. doi:10.1146/annurev.psych.54.101601.145030
3.
BosnjakM.TutenT. L. (2003). Prepaid and promised incentives in web surveys. Social Science Computer Review, 21, 208–217. doi:10.1177/0894439303021002006
4.
BusbyD. M.YoshidaK. (2015). Challenges with online research for couples and families: Evaluating nonrespondents and the differential impact of incentives. Journal of Child and Family Studies, 24, 505–513. doi:10.1007/s10826-013-9863-6
5.
ChurchA. H. (1993). Estimating the effect of incentives on mail survey response rates: A meta-analysis. Public Opinion Quarterly, 57, 62–79.
6.
CranfordJ. A.McCabeS. E.BoydC. J.SlaydenJ.ReedM. B.KetchieJ. M.…ScottM. S. (2008). Reasons for nonresponse in a web-based survey of alcohol involvement among first-year college students. Addictive Behaviors, 33, 206–210. doi:10.1016/j.addbeh.2007.07.008
7.
de LoozeM.ter BogtT. F.VolleberghW. A. (2013). Explaining educational differences in adolescent substance use and sexual activity the role of conceptions and expectations of adulthood. Emerging Adulthood, 1, 175–184. doi:10.1177/2167696812471942
8.
DeyE. L. (1997). Working with low survey response rates: The efficacy of weighting adjustments. Research in Higher Education, 38, 215–227.
9.
DillmanD. A. (2000). The role of behavioral survey methodologists in national statistical agencies. International Statistical Review, 68, 200–213. doi:10.1111/j.1751-5823.2000.tb00323.x
10.
EckenrodeJ.BolgerN. (1997). Daily and within-day event measurement. In CohenS.KesslerR. C. (Eds.), Measuring stress: A guide for health and social scientists (pp. 80–101). London, England: Oxford University Press.
11.
FuligniA. J.TelzerE. H.BowerJ.ColeS. W.KiangL.IrwinM. R. (2009). A preliminary study of daily interpersonal stress and C-reactive protein levels among adolescents from Latin American and European backgrounds. Psychosomatic Medicine, 71, 329–333. doi:10.1097/PSY.0b013e3181921b1f
12.
GöritzA. S. (2014). Determinants of the starting rate and the completion rate in online panel studies. In CallegaroR.BakerR.BethlehemJ.GöritzA. S.KrosnickJ. A.LavrakasP. J. (Eds.), Online panel research (pp. 154–170). New York, NY: John Wiley.
13.
GravleeC. C.KennedyD. P.GodoyR.LeonardW. R. (2009). Methods for collecting panel data: What can cultural anthropology learn from other disciplines. Journal of Anthropological Research, 65, 453–483. doi:10.3998/jar.0521004.0065.304
14.
HelgesonJ. G.VossK. E.TerpeningW. D. (2002). Determinants of mail-survey response: Survey design factors and respondent factors. Psychology and Marketing, 19, 303–328. doi:10.1002/mar.1054
15.
HenkerB.WhalenC. K.JamnerL. D.DelfinoR. J. (2002). Anxiety, affect, and activity in teenagers: Monitoring daily life with electronic diaries. Journal of the American Academy of Child and Adolescent Psychiatry, 41, 660–670. doi:10.1097/00004583-200206000-00005
16.
HowardA. L. (2015). Leveraging time-varying covariates to test within-and between-person effects and interactions in the multilevel linear model. Emerging Adulthood, 3, 400–412. doi:10.1177/2167696815592726
17.
HowardK. I.KrauseM. S.OrlinskyD. E. (1986). The attrition dilemma: Toward a new strategy for psychotherapy research. Journal of Consulting and Clinical Psychology, 54, 106–110. doi:10.1037/0022-006X.54.1.106
18.
KrautR.OlsonJ.BanajiM.BruckmanA.CohenJ.CouperM. (2004). Psychological research online: Report of board of scientific affairs’ advisory group on the conduct of research on the internet. American Psychologist, 59, 105–117. doi:10.1037/0003-066X.59.2.105
19.
LattermanJ.MerzJ. F. (2001). How much are subjects paid to participate in research?American Journal of Bioethics, 1, 45–46.
20.
McCoyT. P.IpE. H.BlockerJ. N.ChampionH.RhodesS. D.WagonerK. G.…WolfsonM. (2009). Attrition bias in a US internet survey of alcohol use among college freshmen. Journal of Studies on Alcohol and Drugs, 70, 606–614. doi:10.15288/jsad.2009.70.606
21.
MillerR.PerlmanD.BrehmS. (2007). Intimate relationships. New York, NY: McGraw-Hill College.
22.
NishinaA. (2012). Adolescent daily and general maladjustment: Is there reactivity to daily repeated measures methodologies?Child Development, 83, 405–412. doi:10.1111/j.1467-8624.2011.01718.x
23.
OesterleS.HawkinsJ. D.HillK. G.BaileyJ. A. (2010). Men’s and women’s pathways to adulthood and their adolescent precursors. Journal of Marriage and Family, 72, 1436–1453. doi:10.1111/j.1741–3737.2010.00775.x
24.
ParraL. A.BenibguiM.HelmJ. L.HastingsP. D. (2016). Minority stress predicts depression in lesbian, gay, and bisexual emerging adults via elevated diurnal cortisol. Emerging Adulthood, 4, 365–372. doi:10.1177/2167696815626822
25.
PikeG. R. (2007). Adjusting for nonresponse in surveys. Higher Education Handbook of Theory and Research, XXII, 411–449. doi:10.1007/978-1-4020-5666-6_8
26.
PorterS. R. (2004). Raising response rates: What works?New Directions for Institutional Research, 2004, 5–21. doi:10.1002/ir.97
27.
PorterS. R.UmbachP. (2006). Student survey response rates across institutions: Why do they vary?Research in Higher Education, 47, 229–247. doi:10.1007/s11162-005-8887-1
28.
PorterS. R.WhitcombM. E. (2005). Non-response in student surveys: The role of demographics, engagement and personality. Research in Higher Education, 46, 127–152. doi:10.1007/s11162-004-1597-2
29.
RipleyE. B. D.MacrinaF.MarkowitzM.GenningsC. (2010). Why do we pay? A national survey of investigators and IRB chairpersons. Journal of Empirical Research on Human Research Ethics, 5, 43–56. doi:10.1525/jer.2010.5.3.43
30.
SaxL. J.GilmartinS. K.LeeJ. J.HagedornL. S. (2008). Using web surveys to reach community college students: An analysis of response rates and response bias. Community College Journal of Research and Practice, 32, 712–729. doi:10.1080/10668920802000423
31.
SchneiderB. (2006). In the moment: The benefits of the experience sampling method. In Pitt-CatsouphesM.KossekE. E.SweetS. (Eds.), The work and family hand-book: Multi-disciplinary perspectives, methods, and approaches (pp. 469–488). Mahwah, NJ: Lawrence Erlbaum.
32.
SwansonJ. A. (2016). Trends in literature about emerging adulthood: Review of empirical studies. Emerging Adulthood, 4, 1–12. doi:10.1177/2167696816630468
33.
SyedM.AzmitiaM. (2009). Longitudinal trajectories of ethnic identity during the college years. Journal of Research on Adolescence, 19, 601–624. doi:10.1111/j.1532-7795.2009.00609.x
34.
SyedM.MitchellL. L. (2013). Race, ethnicity, and emerging adulthood: Retrospect and prospects. Emerging Adulthood, 1, 83–95.
35.
SzelényiK.BryantA. N.LindholmJ. A. (2005). What money can buy: Examining the effects of prepaid monetary incentives on survey response rates among college students. Educational Research and Evaluation, 11, 385–404. doi:10.1080/13803610500110174
36.
TerenziniP. T. (2010). Assessment with open eyes: Pitfalls in studying student outcomes. New Directions for Institutional Research, 2010, 29–46. doi: 10.1002/ir.329
37.
ThomasV.AzmitiaM. (2016). Tapping into the app updating the experience sampling method for the 21st century. Emerging Adulthood, 4, 60–67. doi:10.1177/2167696815618489
38.
U.S. Department of Education, National Center for Education Statistics. (2017). The Condition of Education 2017 (NCES 2017-144).
39.
UmbachP. (2005). Getting back to the basics of survey research. New Directions for Institutional Research, 2005, 91–100. doi:10.1002/ir.157
40.
van RoekelE.HaT.ScholteR. H. J.EngelsR. C. M. E.VerhagenM. (2016). Loneliness in the daily lives of young adults: Testing a socio-cognitive model. European Journal of Personality, 30, 19–30. doi:10.1002/per.2028
41.
WarneckeR. B.ParsonsJ. A. (2001). Longitudinal research: Panel retention. In SmelserN. J.BaltesP. B. (Eds.), International encyclopedia of the social & behavioral sciences (pp. 9067–9071). Oxford, England: Pergamon. doi:10.1016/B0-08-043076-7/00749-X
42.
WhiteJ. M.KleinD. M. (2007). Family theories (3rd ed.). Thousand Oaks, CA: Sage.
43.
YipT.FuligniA. J. (2002). Daily variation in ethnic identity, ethnic behaviors, and psychological well-being among American adolescents of Chinese descent. Child Development, 73, 1557–1572.
