We investigated teacher effects (magnitude, predictors, and cumulativeness) on primary students’ achievement trajectories in Chile, using multilevel cross-classified (accelerated) growth models (four overlapping cohorts, spanning Grades 3 to 8; n = 19,704 students, and 851 language and 812 mathematics teachers, in 156 schools). It was found that teacher effects on achievement growth are large, exceeding school effects. Also, the contribution of teachers to student achievement growth was found to accumulate over time. The study advances the field by exploring teacher effects in the context of an emerging economy, contributing further evidence on the properties of teacher effects on student achievement growth and demonstrating the combined use of accelerated longitudinal designs, growth curve approaches, and cross-classified and multiple membership models.
AllisonP. D. (2000). Multiple imputation for missing data: A cautionary tale. Sociological Methods & Research, 28, 301–309.
2.
AlvaradoM.CabezasG.FalckD.OrtegaM. E. (2012). La evaluación docente y sus instrumentos: Discriminación del desempeño docente y asociación con los resultados de los estudiantes [The teacher evaluation system and its instruments: Teacher performance prediction and association with students’ results]. Santiago, Chile: Ministerio de Educación de Chile (MIDEUC) - Programa de las Naciones Unidas para el Desarrollo (PNUD).
3.
AntoniouP. (2012). The short- and long-term effects of secondary schools upon students’ academic success and development. Educational Research and Evaluation, 18, 621–639.
4.
AvalosB.MatusC. (2010). La formación inicial docente en Chile. Informe nacional del estudio internacional IEA TEDS-M [Initial teacher training in Chile. National report of the international study IEA TEDS-M]. Santiago: Gobierno de Chile.
5.
BeretvasN. (2008). Cross-classified random effects models. In O’ConnellA. A.McCoachD. B. (Eds.), Multilevel modeling of educational data (pp. 161–197). Charlotte, NC: Information Age.
6.
BeretvasS. N. (2011). Cross-classified and multiple membership models. In HoxJ. J.RobertsJ. K. (Eds.), Handbook of advanced multilevel analysis (pp. 313–334). New York, NY: Routledge.
7.
BlazarD.KraftM. A. (2017). Teacher and teaching effects on students’ attitudes and behaviors. Educational Evaluation and Policy Analysis, 39, 146–170.
8.
BrowneW. J. (2012). MCMC estimation in MLwiN, v2.26. Bristol, UK: Centre for Multilevel Modelling, University of Bristol.
9.
BrunnerJ. J.UribeD. (2007). Mercados universitarios: El nuevo escenario de la educación superior [University markets: The new higher education scenario]. Santiago, Chile: Universidad Diego Portales.
10.
CarnoyM. (2007). La mejora de la calidad y equidad educativa: una vision realista [The improvement of educational quality and equity: A realistic view]. Revista Pensamiento Educativo, 40, 87–102.
11.
ChoiI.WilsonM. (2016). Incorporating mobility in growth modeling for multilevel and longitudinal item response data. Multivariate Behavioral Research, 51, 120–137.
12.
ClotfelterC. T.LaddH. F.VigdorJ. L. (2006). Teacher-student matching and the assessment of teacher effectiveness. Cambridge, MA: National Bureau of Economic Research.
13.
ClotfelterC. T.LaddH. F.VigdorJ. L. (2007). Teacher credentials and student achievement: Longitudinal analysis with student fixed effects. Economics of Education Review, 26, 673–682.
14.
CreemersB. P. M.KyriakidesL.SammonsP. (2010). Methodological advances in educational effectiveness research. London, England: Routledge
15.
Darling-HammondL. (2000). Teacher quality and student achievement: A review of state policy evidence. Education Policy Analysis Archives, 8, 1–50.
16.
FieldingA.GoldsteinH. (2006). Cross-classified and multiple membership structures in multilevel models: An introduction and review. London, England: Department for Education and Skills.
17.
GoldhaberD. D.BrewerD. J. (2000). Does teacher certification matter? High school teacher certification status and student achievement. Educational Evaluation and Policy Analysis, 22, 129–145.
GoldsteinH.SammonsP. (2006). The influence of secondary and junior schools on sixteen year examination performance: A cross-classified multilevel analysis. School Effectiveness and School Improvement, 8, 219–230. doi:10.1080/0924345970080203
20.
GradyM. W. (2010). Modeling achievement in the presence of student mobility: A growth curve model for multiple membership data (Unpublished doctoral dissertation). The University of Texas at Austin.
21.
GradyM. W.BeretvasS. N. (2010). Incorporating student mobility in achievement growth modeling: A cross-classified multiple membership growth curve model. Multivariate Behavioral Research, 45, 393–419.
22.
GreenwaldR.HedgesL. V.LaineR. D. (1996). The effect of school resources on student achievement. Review of Educational Research, 66, 361–396.
23.
GroenwoldR. H.DondersA. R.RoesK. C.HarrellF. E.Jr.MoonsK. G. (2012). Dealing with missing outcome data in randomized trials and observational studies. American Journal of Epidemiology, 175, 210–217.
24.
GuldemondH.BoskerR. J. (2009). School effects on students’ progress—A dynamic perspective. School Effectiveness and School Improvement, 20, 255–268.
25.
HanushekE. A. (1997). Assessing the effects of school resources on student performance: An update. Educational Evaluation and Policy Analysis, 19, 141–164.
26.
HanushekE. A.KainJ.O’BrienD.RivkinS. G. (2005). The market for teacher quality. Cambridge, MA: National Bureau of Economic Research.
27.
HanushekE. A.RivkinS. G. (2010). Generalizations about using value-added measures of teacher quality. The American Economic Review, 100, 267–271.
28.
HattieJ. (2009). Visible learning: A synthesis of over 800 meta-analyses relating to achievement. New York, NY: Routledge.
29.
HillP. W.RoweK. J. (1996). Multilevel modelling in school effectiveness research. School Effectiveness and School Improvement, 7, 1–34.
30.
HillP. W.RoweK. J. (1998). Modelling student progress in studies of educational effectiveness. School Effectiveness and School Improvement, 9, 310–333.
31.
KontopantelisE.WhiteI. R.SperrinM. (2017). Outcome-sensitive multiple imputation: A simulation study. BMC Medical Research Methodology, 17(1), Article 2.
32.
Kukla-AcevedoS.StreamsM.TomaE. F. (2009). Evaluation of teacher preparation programs: A reality show in Kentucky. Lexington: University of Kentucky.
33.
KupermintzH. (2003). Teacher effects and teacher effectiveness: A validity investigation of the Tennessee value added assessment system. Educational Evaluation and Policy Analysis, 25, 287–298.
34.
KyriakidesL.CreemersB. P. M. (2008). A longitudinal study on the stability over time of school and teacher effects on student outcomes. Oxford Review of Education, 34, 521–545.
35.
LaraB.MizalaA.RepettoA. (2010). Una mirada a la efectividad de los profesores en Chile [An overview of teacher effectiveness in Chile]. Estudios Públicos, 120, 147–182.
36.
LeckieG. (2009). The complexity of school and neighbourhood effects and movements of pupils on school differences in models of educational achievement. Journal of the Royal Statistical Society: Series A, 172, 537–554.
LeckieG.CharltonC. (2013). Runmlwin: A program to run the MLwiN multilevel modeling software from within Stata. Journal of Statistical Software, 52(11), 1–40.
39.
LeónM.ManziJ.ParedesR. (2009). Calidad docente y rendimiento escolar en Chile: Evaluando la evaluación [Teacher quality and student achievement in Chile: Evaluating the evaluation]. Santiago: Pontificia Universidad Católica de Chile.
40.
LerouxA. J.BeretvasS. N. (2018). Estimation of a latent variable regression growth curve model for individuals cross-classified by clusters. Multivariate Behavioral Research, 53, 231–246.
41.
LittleR. J. A. (1992). Regression with missing X’s: A review. Journal of the American Statistical Association, 87, 1227–1237.
42.
LittleR. J. A.RubinD. B. (2002). Statistical analysis with missing data (2nd ed.). Hoboken, NJ: John Wiley.
43.
LockwoodJ. R.McCaffreyD. F.MarianoL. T.SetodjiC. (2007). Bayesian methods for scalable multivariate value-added assessment. Journal of Educational and Behavioral Statistics, 32, 125–150.
44.
LunnD.JacksonC.BestN.ThomasA.SpiegelhalterD. (2012). The bugs book: A practical introduction to Bayesian analysis. Boca Raton, FL: CRC Press.
45.
LuoW.KwokO. (2012). The consequences of ignoring individuals’ mobility in multilevel growth models. Journal of Educational and Behavioral Statistics, 37, 31–56.
46.
LuytenH. (2003). The size of school effects compared to teacher effects: An overview of the research literature. School Effectiveness and School Improvement, 14, 31–51.
47.
MaasC. J. M.HoxJ. J. (2005). Sufficient sample sizes for multilevel modeling. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 1, 86–92.
48.
ManziJ.LacernaP.MeckesL.RamosI.OrtegaL. (2012). ¿Qué características de la formación inicial de los docentes se asocian a mayores avances en su aprendizaje de conocimientos disciplinarios? [What are the characteristics of teacher initial training associated with teachers’ progress in disciplinary knowledge?]. Santiago, Chile: Ministerio de Educación.
49.
MatearA. (2007). Equity in education in Chile: The tensions between policy and practice. International Journal of Educational Development, 27, 101–113.
50.
McCaffreyD. F.LockwoodJ. R.KoretzD.LouisT. A.HamiltonL. (2004). Models for value-added modeling of teacher effects. Journal of Educational and Behavioral Statistics, 29, 67–101.
51.
McCaffreyD. F.LockwoodJ. R.KoretzD. M.HamiltonL. (2003). Evaluating value-added models for teacher accountability. Santa Monica, CA: RAND Corporation.
52.
MeyersJ. L.BeretvasS. N. (2006). The impact of inappropriate modeling of cross-classified data structures. Multivariate Behavioral Research, 41, 473–497.
53.
Ministerio de Educación. (2015). Resultados de la evaluación Inicia 2014 [Inicia assessment results 2014]. Santiago, Chile: Author.
54.
MoerbeekM. (2004). The consequence of ignoring a level of nesting in multilevel analysis. Multivariate Behavioral Research, 39, 129–149.
55.
MuijsD.KyriakidesL.van der WerfG.CreemersB.TimperleyH.EarlL. (2014). State of the art: Teacher effectiveness and professional learning. School Effectiveness and School Improvement, 25, 231–256.
56.
MuñozM. A.ChangF. C. (2007). The elusive relationship between teacher characteristics and student academic growth: A longitudinal multilevel model for change. Journal of Personnel Evaluation in Education, 20, 147–164.
57.
MurilloF. (2007). Investigación iberoamericana sobre eficacia escolar (IIEE) [Ibero-American research on school effectiveness (IIEE)]. Bogotá, Colombia: Convenio Andrés Bello.
58.
MuthénL. K.MuthénB. O. (2010). MPLUS user’s guide. Los Angeles, CA: Author.
59.
NyeB.KonstantopoulosS.HedgesL. V. (2004). How large are teacher effects?Educational Evaluation and Policy Analysis, 26, 237–257.
60.
Organisation for Economic Co-Operation and Development. (2013). PISA 2012 results: Excellence through equity—Giving every student the chance to succeed (Vol. II). Paris, France: Author.
61.
OrtegaL. (2016). Educational effectiveness and inequalities in Chile: A multilevel accelerated longitudinal study of primary school children’s achievement trajectories (Unpublished doctoral thesis). University of Oxford, UK.
62.
OrtegaL.MalmbergL.-E.SammonsP. (2018). School effects on Chilean children’s achievement growth in language and mathematics: An accelerated growth curve model. School Effectiveness and School Improvement, 29, 308–337. doi:10.1080/09243453.2018.1443945
63.
OrtúzarM.FloresC.MilesiC.CoxC. (2009). Aspectos de la formación inicial docente y su influencia en el rendimiento académico de los alumnos [Aspects of initial teacher training and its influence on student academic achievement]. In Camino al bicentenario, propuestas para Chile (pp. 155–186). Santiago, Chile: Ediciones Universidad Católica.
64.
PalardyG. J. (2010). The multilevel crossed random effects growth model for estimating teacher and school effects: Issues and extensions. Educational and Psychological Measurement, 70, 401–419.
65.
PapayJ. (2011). Different tests, different answers: The stability of teacher value-added estimates across outcome measures. American Educational Research Journal, 48, 163–193.
PustjensH.Van de gaerE.Van DammeJ.OnghenaP.Van LandeghemG. (2007). The short-term and the long-term effect of primary schools and classes on mathematics and language achievement scores. British Educational Research Journal, 33, 419–440.
68.
RafteryA. E.LewisS. M. (1992). How many iterations in the Gibbs sampler? In BernardoJ. M.BergerJ. O.DawidA. P.SmithA. F. M. (Eds.), Bayesian statistics4 (pp. 763–773). Oxford, UK: Oxford University Press.
69.
RamírezM. J. (2006). Factors related to mathematics achievement in Chile. In HowieS. J.PlompT. (Ed.), Context of learning mathematics and science: Lessons learned from TIMSS (pp. 97–112). London, England: Routledge.
70.
RasbashJ.BrowneW. J. (2001). Modelling non-hierarchical structures. In LeylandA. H.GoldsteinH. (Eds.), Multilevel modelling of health statistics (pp. 93–105). Chichester, UK: John Wiley.
71.
RaudenbushS. W. (1993). A crossed random effects model for unbalanced data with applications in cross-sectional and longitudinal research. Journal of Educational Statistics, 18, 321–349.
72.
RaudenbushS. W. (1995). Hierarchical linear models to study the effects social context on development. In GottmanJ. M. (Ed.), The analysis of change (pp. 165–201). Mahwah, NJ: Lawrence Erlbaum.
73.
RaudenbushS. W.BrykA. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: SAGE.
74.
RaudenbushS. W.LiuX. (2000). Statistical power and optimal design for multisite randomized trials. Psychological Methods, 5, 199–213.
75.
ReynoldsD.SammonsP.De FraineB.Van DammeJ.TownsendT.TeddlieC.StringfieldS. (2014). Educational effectiveness research (EER): A state-of-the-art review. School Effectiveness and School Improvement, 25, 197–230.
76.
RivkinS. G.HanushekE. A.KainJ. F. (2005). Teachers, schools, and academic achievement. Econometrica, 73, 417–458.
77.
RockoffJ. E. (2004). The impact of individual teachers on student achievement: Evidence from panel data. The American Economic Review, 94, 247–252.
78.
RogosaD.BrandD.ZimowskiM. (1982). A growth curve approach to the measurement of change. Psychological Bulletin, 92, 726–748.
79.
RothsteinJ. (2009). Student sorting and bias in value added estimation: Selection on observables and unobservables. Education Finance and Policy, 4, 537–571.
80.
RowanB.CorrentiR.MillerR. J. (2002). What large-scale, survey research tells us about teacher effects on student achievement: Insights from the prospects study of elementary schools. Teachers College Record, 104, 1525–1567.
81.
RubinD. B. (1987). Multiple imputation for nonresponse in surveys. New York, NY: John Wiley.
82.
SammonsP.DavisS.GrayJ. (2016). The scientific properties of school effects. In ChapmanC.MuijsD.ReynoldsD.SammonsP.TeddlieC. (Eds.), The Routledge international handbook of educational effectiveness and improvement: Research, policy, and practice (pp. 25–76). New York, NY: Routledge.
83.
SammonsP.LuytenH. (2009). Editorial article for special issue on alternative methods for assessing school effects and schooling effects. School Effectiveness and School Improvement, 20, 133–143.
84.
SchaferJ. L.GrahamJ. W. (2002). Missing data: Our view of the state of the art. Psychological Methods, 7, 147–177.
85.
ScheerensJ.BoskerR. J. (1997). The foundations of educational effectiveness. New York, NY: Pergamon Press.
86.
SingerJ.WillettJ. B. (2003). Applied longitudinal data analysis: Modeling change and event occurrence. Oxford, UK: Oxford University Press.
87.
SullivanT. R.SalterA. B.RyanP.LeeK. J. (2015). Bias and precision of the “multiple imputation, then deletion” method for dealing with missing outcome data. American Journal of Epidemiology, 182, 528–534.
88.
TattoM. T.SchwilleJ.SenkS. L.IngvarsonL.RowleyG.PeckR.. . . ReckaseM. D. (2012). Policy, practice, and readiness to teach primary and secondary mathematics in 17 countries: Findings from the IEA teacher education and development study in mathematics (TEDS-M). Amsterdam, The Netherlands: International Association for the Evaluation of Educational Achievement.
89.
TeddlieC.ReynoldsD. (Eds.). (2000). The international handbook of school effectiveness research. London, England: Falmer Press.
90.
ThomasS.SammonsP.MortimoreP.SmeesR. (1997). Stability and consistency in secondary schools’ effects on students’ GCSE outcomes over three years. School Effectiveness and School Improvement, 8, 169–197.
91.
ThumY. M. (2003). Measuring progress toward a goal: Estimating teacher productivity using a multivariate multilevel model for value-added analysis. Sociological Methods & Research, 32, 153–207.
92.
TymmsP.MerrellC.HendersonB. (2000). Baseline assessment and progress during the first three years at school. Educational Research and Evaluation, 6, 105–129.
93.
United Nations Educational, Scientific and Cultural Organization. (2015a). Tercer estudio regional comparativo y explicativo. Factores asociados [Third regional comparative and explicative study. Associated factors]. Paris, France: Author.
94.
United Nations Educational, Scientific and Cultural Organization. (2015b). Tercer estudio regional comparativo y explicativo. Logros de aprendizajes [Third regional comparative and explicative study. Learning achievement]. Paris, France: Author.
95.
van den NoortgateW.OpdenakkerM.-C.OnghenaP. (2005). The effects of ignoring a level in multilevel analysis. School Effectiveness and School Improvement, 16, 281–303.
96.
VelezE.SchiefelbeinE.ValenzuelaJ. (1993). Factors affecting achievement in primary education. Washington, DC: The World Bank.
97.
Von HippelP. (2007). Regression with missing Ys: An improved strategy for analyzing multiply imputed data. Sociological Methodology, 37, 83–117.
98.
WallaceM. L. (2015). Modeling cross-classified data with and without the crossed factors’ random effects’ interaction (Unpublished doctoral dissertation). The University of Texas at Austin.
99.
WayneA. J.YoungsP. (2003). Teacher characteristics and student achievement gains: A review. Review of Educational Research, 73, 89–122.
100.
WillmsJ. D.SomerM.-A. (2001). Family, classroom, and school effects on children’s educational outcomes in Latin America. School Effectiveness and School Improvement, 12, 409–445.
101.
WrightS. P.HornS. P.SandersW. L. (1997). Teacher and classroom context effects on student achievement: Implications for teacher evaluation. Journal of Personnel Evaluation in Education, 11, 57–67.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
