The impact of ignoring lags on developmental science: A re-analysis of meta-analyses using lag as moderator

Abstract

Longitudinal studies provide developmental science with invaluable information about how variables and the associations between variables change across time, but typically give limited attention to the length of time over which that change occurs. The present study re-analyzed data from previously published meta-analyses of longitudinal data across a broad range of developmental science to ascertain how lag may have impacted coefficients of stability (k_{meta-analyses} = 6, k_studies = 157) and prediction (k_{meta-analyses} = 15, k_studies = 270). We additionally analyzed how average participant age interacts with lag to test how the impact of lag might change across the lifespan. Findings indicate that conventional lags (e.g., 6 months, 12 months) were used at extremely high rates: More than 75% of lags were selected based on convention. Linear and nonlinear models indicated that lag moderated stability and predictive associations, although the significance, magnitude, and direction of this impact changed depending on the phenomenon under investigation. Average participant age interacted with lag in certain cases, providing a possibility for more time-specific developmental theory. However, these results should not be considered conclusive due to the high number of conventional lags in our sample, which likely restricted both variability in lags and the length of those lags. Future longitudinal studies should measure phenomena at varying lags, and future meta-analysts should consider both lag and average participant age when synthesizing longitudinal research. Both practices would enable developmental science to determine the interval over which a phenomenon occurs and facilitate advancements in developmental theory.

Keywords

Longitudinal study meta-analysis development temporal design methodology

Get full access to this article

View all access options for this article.

References

Bornstein

M. H.

Putnick

D. L.

Esposito

(2017). Continuity and stability in development. Child Development Perspectives, 11(2), 113–119. https://doi.org/10.1111/cdep.12221

Cain

M. K.

Zhang

Bergeman

C. S.

(2018). Time and other considerations in mediation design. Educational and Psychological Measurement, 78(6), 952–972. https://doi.org/10.1177/0013164417743003

Card

N. A.

(2012). Applied meta-analysis for social science research. Guilford Press.

Card

N. A.

(2019). Lag as moderator meta-analysis: A methodological approach for synthesizing longitudinal data. International Journal of Behavioral Development, 43(1), 80–89. https://doi.org/10.1177/0165025418773461

Card

N. A.

Little

T. D.

(2007). Longitudinal modeling of developmental process. International Journal of Behavioral Development, 31(4), 297–302. https://doi.org/10.1177/0165025407077750

Cole

D. A.

Maxwell

S. E.

(2003). Testing mediational models with longitudinal data: Questions and tips in the use of structural equation modeling. Journal of Abnormal Psychology, 112, 58–577. https://doi.org/10.1037/0021-843X.112.4.558

Collins

L. M.

(2006). Analysis of longitudinal data: The integration of theoretical model, temporal design, and statistical model. Annual Review of Psychology, 57, 505–528. https://doi.org/10.1146/annurev.psych.57.102904.190146

Collins

L. M.

Graham

J. W.

(2002). The effect of timing and spacing of observations in longitudinal studies of tobacco and other drug use: Temporal design considerations. Drug and Alcohol Dependence, 68, 85–96. https://doi.org/10.1016/s0376-8716(02)00217-x

Dormann

Griffin

M. A.

(2015). Optimal time lags in panel studies. Psychological methods, 20(4), 489. https://doi.org/10.1037/met0000041

10.

Gollob

H. F.

Reichardt

C. S.

(1987). Taking account of time lags in causal models. Child Development, 58(1), 80–92.

11.

Little

T. D.

(2013). Longitudinal structural equation modeling. Guilford Press.

12.

Little

T. D.

Card

N. A.

Preacher

K. J.

McConnell

(2009). Modeling longitudinal data from research on adolescence. In Lerner

R. M.

Steinberg

(Eds.), Handbook of adolescent psychology (3rd ed., pp. 15–54). Wiley.

13.

McArdle

J. J.

Woodcock

R. W.

(1997). Expanding test–retest designs to include developmental time-lag components. Psychological Methods, 2(4), 403–435. https://doi.org/10.1037/1082-989X.2.4.403

14.

Pelz

D. C.

Lew

R. A.

(1970). Heise’s causal model applied. In Borgatta

E. F.

Bohrnstedt

(Eds.), Sociological methodology (pp. 28–37). Jossey-Bass.

15.

Selig

J. P.

Preacher

K. J.

Little

T. D.

(2012). Modeling time-dependent association in longitudinal data: A lag as moderator approach. Multivariate Behavioral Research, 47(5), 697–716. https://doi.org/10.1080/00273171.2012.715557

16.

Timmons

A. C.

Preacher

K. J.

(2015). The importance of temporal design: How do measurement intervals affect the accuracy and efficiency of parameter estimates in longitudinal research? Multivariate Behavioral Research, 50, 41–55. https://doi.org/10.1080/00273171.2014.961056

17.

Viechtbauer

(2010). Conducting meta-analyses in R with the metafor package. Journal of Statistical Software, 36(3), 1–48. https://www.jstatsoft.org/v36/i03/

18.

Woodard

Pollak

S. D.

(2020). Is there evidence for sensitive periods in emotional development? Current Opinion in Behavioral Sciences, 36, 1–6. https://doi.org/10.1016/j.cobeha.2020.05.004

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.09 MB

0.10 MB