Using Paradata to Evaluate Youth Participation in a Digital Diary Study

Abstract

We analyze recruitment, access, and longitudinal response paradata from a yearlong intensive longitudinal study (mDiary) that used a mobile-optimized web app to administer 25 biweekly diaries to youth recruited from a birth cohort study. Analyses investigate which aspects of teen recruitment experiences are associated with enrollment and longitudinal response patterns; whether compliance behavior of teens who require multiple invitations to enroll differs from that of teens who enroll on the first invitation, and what personal and social circumstances are associated with different longitudinal compliance patterns. Latent class analysis (LCA) is used to derive longitudinal compliance classes. mDiary’s person-survey response rate of 70% is noteworthy considering reports that response rates for smartphone studies trail those administered via telephone or personal computers. Conditional on agreeing to participate, teens with texting capability were over 6 times as likely to enroll as their peers lacking access, and they also completed six to seven more diaries. Youth who required multiple prods to register not only were less likely to enroll than their peers who registered at the first invitation but also tended to attrite early. Compared with teens who completed all 25 surveys, those who attrited early had less access to texting capability, home Internet service, and also had low-education mothers. Consistent with studies of adults, nonparticipants were disproportionately Black males from socioeconomically disadvantaged backgrounds.