Sage Journals: Discover world-class research

Abstract

Selective non-participation and attrition pose a ubiquitous threat to the validity of inferences drawn from observational longitudinal studies. We investigate various potential predictors for non-response and attrition of parents as well as young persons at different stages of a multi-informant study. Various phases of renewed consent from parents and young persons allowed for a unique comparison of factors that drive participation. The target sample consisted of 1675 children entering primary school at age seven in 2004. Seven waves of interviews, over the course of 10 years, measured levels of problem behavior as rated by children, parents, and teachers. In the initial study recruitment, where participation was driven by parental consent, non-response was highest amongst certain socially disadvantaged immigrant minority groups. There were fewer significant group differences at wave 5, when young people could be directly recruited into the study. Similarly, attrition was higher for some immigrant background groups. Methodological implications for future analyses are discussed.

Keywords

Criminology attrition non-response study-participation longitudinal study

Get full access to this article

View all access options for this article.

References

American Psychiatric Association (2013). Diagnostic and statistical manual of mental disorders (DSM-5). Arlington, VA: APA.

Asendorpf

J. B.

van de Schoot

Denissen

J. J.

Hutteman

(2014). Reducing bias due to systematic attrition in longitudinal studies: the benefits of multiple imputation. International Journal of Behavioral Development, 38, 453–460.

Asparouhov

(2005). Sampling weights in latent variable modeling. Structural Equation Modeling, 12, 411–434.

Audrain

Tercyak

K. P.

Goldman

Bush

(2002). Recruiting adolescents into genetic studies of smoking behavior. Cancer Epidemiology, Biomarkers & Prevention, 11, 249–252.

Barry

T. D.

Lyman

R. D.

Klinger

L. G.

(2002). Academic underachievement and attention-deficit/hyperactivity disorder: The negative impact of symptom severity on school performance. Journal of School Psychology, 40, 259–283.

Brame

Piquero

A. R.

(2003). Selective attrition and the age-crime relationship. Journal of Quantitative Criminology, 19, 107–127.

Couper

M. P.

De Leeuw

E. D.

(2003). Nonresponse in cross-cultural and cross-national surveys. In Harkness

J. A.

van de Vijver

F. J. R.

Mohler

P. P.

(Eds.), Cross-Cultural Survey Methods (pp. 157–178). New York, NY: Wiley.

Curtin

Presser

Singer

(2000). The effects of response rate changes on the index of consumer sentiment. Public Opinion Quarterly, 64, 413–428.

De Los Reyes

(2011). Introduction to the special section. More than measurement error: discovering meaning behind informant discrepancies in clinical assessments of children and adolescents. Journal of Clinical Child and Adolescent Psychology, 40, 1–9.

10.

Eisner

Ribeaud

(2007). Conducting a criminological survey in a culturally diverse context: lessons from the Zurich Project on the Social Development of Children. European Journal of Criminology, 4, 271–298.

11.

Enders

C. K.

(2011). Analyzing longitudinal data with missing values. Rehabilitation Psychology, 56, 267–288.

12.

Holm

(1979). A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics, 6, 65–70.

13.

Johnson

T. P.

Fenrich

Mackesy-Amiti

M. E.

(2012). An evaluation of the validity of the Crowne–Marlowe need for approval scale. Quality & Quantity, 46, 1883–1986.

14.

Johnson

T. P.

O’Rourke

Burris

Owens

(2002). Culture and survey nonresponse. In Groves

R. M.

Dillman

D. A.

Eltinge

J. L.

Little

R. J. A.

(Eds.), Survey Nonresponse (pp. 55–69). New York: Wiley.

15.

Kapteyn

Michaud

P-C.

Smith

van Soest

(2006). Effects of attrition and non-response in the Health and Retirement Study. Bonn, Germany: Discussion paper from the Institute for the Study of Labor (IZA).

16.

Keselman

H. J.

Miller

C. W.

Holland

(2011). Many tests of significance: new methods for controlling type-I errors. Psychological Methods, 16, 420–431.

17.

Korkeila

Suominen

Ahvenainen

Ojanlatva

Rautava

Helenius

Koskenvuo

(2001). Non-response and related factors in a nation-wide health survey. European Journal of Epidemiology, 17, 991–999.

18.

Lehmann

E. L.

Romano

J. P.

(2012). Generalizations of the familywise error rate. In Selected Works of E. L. Lehmann. Springer, Boston, MA (pp. 719–735).

19.

Mundia

(2011). Social desirability, non-response bias and reliability in a long self-report measure: illustrations from the MMPI-2 administered to Brunei student teachers. Educational Psychology, 31, 207–224.

20.

Noll

Zeller

M. H.

Vannatta

Bukowski

W. M.

Davies

W. H.

(1997). Potential bias in classroom research: comparison of children with permission and those who do not receive permission to participate. Journal of Clinical Child Psychology, 26, 36–42.

21.

Patterson

G. R.

(1982). Coercive Family Process: A Social Learning Approach (Vol. 3). Eugene, OR: Castalia.

22.

R Core Team (2016). R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from https://www.R-project.org/.

23.

Ribeaud

Eisner

(2010). Risk factors for aggression in pre-adolescence: risk domains, cumulative risk and gender differences—results from a prospective longitudinal study in a multi-ethnic urban sample. European Journal of Criminology, 7, 460–498.

24.

Rosseel

(2012). Lavaan: an R package for structural equation modeling. Journal of Statistical Software, 48, 1–36. Retrieved from http://www.jstatsoft.org/v48/i02/.

25.

Rubin

D. B.

(1976). Inference and missing data. Biometrika, 63, 581–592.

26.

Sackett

P. R.

Yang

(2000). Correction for range restriction: an expanded typology. Journal of Applied Psychology, 85, 112–118.

27.

Schafer

J. L.

Graham

J. W.

(2002). Missing data: our view of the state of the art. Psychological Methods, 7, 147–177.

28.

Singer

J. D.

Willet

J. B.

(2003). Applied Longitudinal Data Analysis: Modeling Change and Event Occurrence. New York, NY: Oxford University Press.

29.

Stoop

I. A. L.

(2005). The Hunt for the Last Respondent. Nonresponse in Sample Surveys. The Hague, Netherlands: Social and Cultural Planning Office of the Netherlands.

30.

Tremblay

R. E.

Loeber

Gagnon

Charlebois

Larivee

LeBlanc

(1991). Disruptive boys with stable and unstable high fighting behavior patterns during junior elementary school. Journal of Abnormal Child Psychology, 19, 285–300.

31.

Ullebø

A. K.

Posserud

M. B.

Heiervang

Obel

Gillberg

(2012). Prevalence of the ADHD phenotype in 7-to 9-year-old children: effects of informant, gender and non-participation. Social Psychiatry and Psychiatric Epidemiology, 47, 763–769.

32.

Valla

J. P.

Bergeron

St. Georges

Berthiaume

(2000). Le Dominique Interactif: présentation, cadre conceptuel, propriétés psychométriques, limites, et utilisations. Revue Canadienne de Psycho-éducation, 29, 327–347.

33.

van Goor

Jamsma

Veenstra

(2005). Differences in undercoverage and nonresponse between city neighborhoods in a telephone survey. Psychological Reports, 96, 867–878.

34.

van Loon

A. J. M.

Tijhuis

Picavet

H. S. J.

Surtees

P. G.

Ormel

(2003) Survey non-response in the Netherlands: effects on prevalence estimates and associations. Annals of Epidemiology, 13, 105–110.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.47 MB

A practical guide to the analysis of non-response and attrition in longitudinal research using a real data example

Abstract

Keywords

Get full access to this article

References

Supplementary Material