Researchers in the field of early adolescence interested in quantifying the environmental influences on a response variable of interest over time would use cluster sampling (i.e., obtaining repeated measures from students nested within classrooms and/or schools) to obtain the needed sample size. The resulting longitudinal data would be nested at three levels (e.g., repeated measures [Level 1], collected across participants [Level 2], and nested within different schools [Level 3]). A previous publication addressed statistical analysis issues specific to cross-sectional three-level data analytic designs. This article expands upon the previous cross-sectional three-level publication to address topics specific to longitudinal three-level data analyses efforts. Although all analysis examples are demonstrated using SAS, the equivalent SPSS and Mplus syntax scripts, as well as the generated example data and additional supplemental materials, are available online.
AikenL. S.WestS. G. (1991). Multiple regression: Testing and interpreting interactions. Thousand Oaks, CA: SAGE.
2.
AndersonD. R. (2008). Model based inference in the life sciences: A primer on evidence. New York, NY: Springer.
3.
BauerD. J.GottfredsonN. C.DeanD.ZuckerR. A. (2013). Analyzing repeated measures data on individuals nested within groups: Accounting for dynamic group effects. Psychological Methods, 18, 1-14. doi:10.1037/a0030639
4.
BiesanzJ. C.Deeb-SossaN.PapadakisA. A.BollenK. A.CurranP. J. (2004). The role of coding time in estimating and interpreting growth curve models. Psychological Methods, 9, 30-52. doi:10.1037/1082-989X.9.1.30
5.
CohenJ. C.CohenP.WestP.AikenS. G. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Mahwah, NJ: Lawrence Erlbaum.
6.
DavisP.ScottA. (1995). The effect of interviewer variance on domain comparisons. Survey Methodology, 21, 99-106.
7.
De LeeuwJ.KreftI. (1986). Random coefficient models for multilevel analysis. Journal of Educational and Behavioral Statistics, 11, 57-85.
8.
EndersC. K. (2010). Applied missing data analysis. New York, NY: Guilford Press.
9.
EndersC. K.TofighiD. (2007). Centering predictor variables in cross-sectional multilevel models: A new look at an old issue. Psychological Methods, 12, 121-138. doi:10.1037/1082-989X.12.2.121
10.
FerronJ.DaileyR.YiQ. (2002). Effects of misspecifying the first-level error structure in two-level models of change. Multivariate Behavioral Research, 37, 379-403. doi:10.1207/S15327906MBR3703_4
11.
GoldsteinH. (2011). Multilevel statistical models (4th ed.). West Sussex, UK: John Wiley.
12.
HeckR. H. (2000). Examining the impact of school quality on school outcomes and improvement: A value-added approach. Educational Administration Quarterly, 36, 513-552. doi:10.1177/0013161X00364002
13.
HeckR. H. (2007). Examining the relationship between teacher quality as an organizational property of schools and students’ achievement and growth rates. Educational Administration Quarterly, 43, 399-432. doi:10.1177/0013161X07306452
14.
HeckR. H.HallingerP. (2009). Assessing the contribution of distributed leadership to school improvement and growth in math achievement. American Educational Research Journal, 46, 659-689. doi:10.3102/0002831209340042
15.
HedekerD.GibbonsR. D. (2006). Longitudinal data analysis. New York, NY: John Wiley.
16.
HedgesL. V.HedbergE. C. (2007). Intraclass correlation values for planning group-randomized trials in education. Educational Evaluation and Policy Analysis, 29, 60-87.
17.
HoffmanL. (2015). Longitudinal analysis: Modeling within-person fluctuation and change. New York, NY: Routledge.
18.
HofmannD. A.GavinM. B. (1998). Centering decisions in hierarchical linear models: Implications for research in organizations. Journal of Management, 24, 623-641.
19.
HoxJ. J. (2010). Multilevel analysis: Techniques and applications (2nd ed.). New York, NY: Routledge.
20.
HoxJ. J.RobertsJ. K. (Eds.). (2011). Handbook of advanced multilevel analysis. New York, NY: Routledge.
21.
KenwardM. G.RogerJ. H. (1997). Small sample inference for fixed effects from restricted maximum likelihood. Biometrics, 53, 983-997.
KreftI. G.De LeeuwJ.AikenL. S. (1995). The effect of different forms of centering in hierarchical linear models. Multivariate Behavioral Research, 30, 1-21.
24.
KwokO. M.WestS. G.GreenS. B. (2007). The impact of misspecifying the within-subject covariance structure in multiwave longitudinal multilevel models: A Monte Carlo study. Multivariate Behavioral Research, 42, 557-592. doi:10.1080/00273170701540537
25.
LiK. H.RaghunathanT. E.RubinD. B. (1991). Large-sample significance levels from multiply imputed data using moment-based statistics and anF reference distribution. Journal of the American Statistical Association, 86, 1065-1073.
26.
LiuS.RovineM. J.MolenaarP. (2012). Selecting a linear mixed model for longitudinal data: Repeated measures analysis of variance, covariance pattern model, and growth curve approaches. Psychological Methods, 17, 15-30. doi:10.1037/a0026971
27.
LongfordN. T. (1993). Random coefficient models. New York, NY: Oxford University Press.
28.
MehtaP. D.WestS. G. (2000). Putting the individual back into individual growth curves. Psychological Methods, 5, 23-43. doi:10.1037/1082-989X.5.1.23
29.
MuthénL. K.MuthénB. O. (1998-2015). Mplus user’s guide (7th ed.). Los Angeles, CA: Author.
30.
NezlekJ. B. (2001). Multilevel random coefficient analyses of event- and interval-contingent data in social and personality psychology research. Personality and Social Psychology Bulletin, 27, 771-785.
31.
PedhazurE. J. (1997). Multiple regression in behavioral research: Explanation and prediction (3rd ed.). Fort Worth, TX: Harcourt Brace College Publishers.
32.
PeughJ. L. (2010). A practical guide to multilevel modeling. Journal of School Psychology, 48, 85-112. doi:10.1016/j.jsp.2009.09.002
33.
PeughJ. L. (2014). Conducting three-level cross-sectional analyses. Journal of Early Adolescence, 34, 7-37. doi:10.1177/0272431613498646
34.
PeughJ. L.EndersC. K. (2005). Using the SPSS mixed procedure to fit cross-sectional and longitudinal multilevel models. Educational and Psychological Measurement, 65, 717-741. doi:10.1177/0013164405278558
35.
RaudenbushS. W.BrykA. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Newbury Park, CA: SAGE.
36.
SchaferJ. L. (1997). Analysis of incomplete multivariate data. Boca Raton, FL: Chapman & Hall.
37.
SiddiquiO.HedekerD.FlayB. R.HuF. B. (1996). Intraclass correlation estimates in a school-based smoking prevention study: Outcome and mediating variables, by gender and ethnicity. American Journal of Epidemiology, 144, 425-433.
38.
SingerJ. D. (1998). Using SAS PROC MIXED to fit multilevel models, hierarchical models, and individual growth models. Journal of Educational and Behavioral Statistics, 24, 323-355. doi:10.3102/10769986023004323
39.
SingerJ. D.WillettJ. B. (2003). Applied longitudinal data analysis: Modeling change and event occurrence. New York, NY: Oxford University Press.
40.
SnijdersT. A. B.BoskerR. J. (1994). Modeled variance in two-level models. Sociological Methods & Research, 22, 342-363.
41.
SnijdersT. A. B.BoskerR. J. (2012). Multilevel analysis: An introduction to basic and advanced multilevel modeling. London, England: SAGE.
42.
VerbekeG.LesaffreE. (1997). The effect of misspecifying the random-effects distribution in linear mixed models for longitudinal data. Computational Statistics & Data Analysis, 23, 541-556.
43.
VerbekeG.MolenberghsG. (2009). Linear mixed models for longitudinal data. New York, NY: Springer.
44.
WuW.WestS. G.TaylorA. B. (2009). Evaluating model fit for growth curve models: Integration of fit indices from SEM and MLM frameworks. Psychological Methods, 14, 183-201.
45.
WuY.-W. B.WooldridgeP. J. (2005). The impact of centering first-level predictors on individual and contextual effects in multilevel data analysis. Nursing Research, 54, 212-216.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
