We apply a difference-in-difference design to measure the causal effect of a teacher obtaining an endorsement in Sheltered English Immersion under Massachusetts’s Rethinking Equity in the Teaching of English Language Learners initiative on student’s learning outcomes. More than 35,000 in-service public school teachers completed the semester-long course. We find no effect on English learners’ (ELs) average test scores, but modest positive spillovers for students with disabilities and other non-EL students. Training benefited teachers recently hired by their district but had no effect on longer serving teachers.
AbadieA.AtheyS.ImbensG. W.WooldridgeJ. (2017). When should you adjust standard errors for clustering?National Bureau of Economic Research. https://www.nber.org/papers/w24003
2.
AbediJ.HofstetterC. H.LordC. (2004). Assessment accommodations for English language learners: Implications for policy-based empirical research. Review of Educational Research, 74(1), 1–28. https://doi.org/10.3102/00346543074001001
3.
AngristJ. D.PischkeJ.-S. (2008). Mostly harmless econometrics: An empiricist’s companion. Princeton University Press.
4.
AugustD.CarloM.DresslerC.SnowC. (2005). The critical role of vocabulary development for English language learners. Learning Disabilities Research & Practice, 20(1), 50–57. https://doi.org/10.1111/j.1540-5826.2005.00120.x
AugustD.ShanahanT. (2017). Developing literacy in second-language learners: Report of the national literacy panel on language-minority children and youth. Routledge.
7.
BakerS.LesauxN.JayanthiM.DiminoJ.ProctorC. P.MorrisJ.GerstenR.HaymondK.KiefferM. J.Linan-ThompsonS.Newman-GoncharR. (2014). Teaching academic content and literacy to English learners in elementary and middle school (NCEE 2014-4012). National Center for Education Evaluation and Regional Assistance (NCEE), Institute of Education Sciences, U.S. Department of Education. http://ies.ed.gov/ncee/wwc/publications_reviews.aspx
8.
BallantyneK. G.SandermanA. R.LevyJ. (2008). Educating English language learners: Building teacher capacity. National Clearinghouse for English Language Acquisition & Language Instruction Educational Programs. https://files.eric.ed.gov/fulltext/ED521360.pdf
9.
BeckI. L.McKeownM. G.KucanL. (2013). Bringing words to life: Robust vocabulary instruction. Guilford Press.
BoulayB.GoodsonB.OlsenR.McCormickR.DarrowC.FryeM.GanK.HarvillE.SarnaM. (2018). The investing in innovation fund: Summary of 67 evaluations (Final report NCEE 2018-4013). National Center for Education Evaluation and Regional Assistance. https://files.eric.ed.gov/fulltext/ED583834.pdf
12.
CalderónM. (2011). Teaching reading & comprehension to English learners, K5. Solution Tree Press.
13.
CalderónM.AugustD.SlavinR.DuranD.MaddenN.CheungA. (2005). Bringing words to life in classrooms with English-language learners. In HiebertE. H.KamilM. L. (Eds.), Teaching and learning vocabulary: Bringing research to practice (pp. 115–136). Lawrence Erlbaum.
14.
CalderonM. E.SlakkS. (2018). Teaching reading to English learners, grades 6–12: A framework for improving achievement in the content areas. Corwin Press.
15.
CallahanR. M.HumphriesM. H. (2016). Undermatched? School-based linguistic status, college going, and the immigrant advantage. American Educational Research Journal, 53(2), 263–295. https://doi.org/10.3102/0002831215627857
16.
Chang-BaconC. K. (2022). Monolingual language ideologies and the Massachusetts sheltered English immersion endorsement initiative: A critical policy analysis. Educational Policy, 36(3), 479–519. https://doi.org/10.1177/0895904820901465
ClotfelterC. T.LaddH. F.VigdorJ. L. (2006). Teacher-student matching and the assessment of teacher effectiveness. Journal of Human Resources, 41(4), 778–820. https://doi.org/10.3368/jhr.xli.4.778
19.
ClotfelterC. T.LaddH. F.VigdorJ. L. (2007). Teacher credentials and student achievement: Longitudinal analysis with student fixed effects. Economics of Education Review, 26(6), 673–682. https://doi.org/10.3386/w13617
20.
ClotfelterC. T.LaddH. F.VigdorJ. L. (2010). Teacher credentials and student achievement in high school: A cross-subject analysis with student fixed effects. Journal of Human Resources, 45(3), 655–681. https://doi.org/10.1353/jhr.2010.0023
21.
CohenJ. (2018). Practices that cross disciplines? Revisiting explicit instruction in elementary mathematics and English language arts. Teaching and Teacher Education: An International Journal of Research and Studies, 69(1), 324–335. https://doi.org/10.1016/j.tate.2017.10.021
22.
ConnorC. M.MorrisonF. J.SchatschneiderC.TosteJ. R.LundblomE.CroweE. C.FishmanB. (2011). Effective classroom instruction: Implications of child characteristics by reading instruction interactions on first graders’ word reading achievement. Journal of Research on Educational Effectiveness, 4(3), 173–207. https://doi.org/10.1080/19345747.2010.510179
CoxS.ParmerR.StrizekG.ThomasT. (2017). Documentation for the 2011–12 schools and staffing survey (NCES 2016-17). National Center for Education Statistics. https://nces.ed.gov/pubs2016/2016817_1.pdf
25.
DabachD. B. (2015). Teacher placement into immigrant English learner classrooms: Limiting access in comprehensive high schools. American Educational Research Journal, 52(2), 243–274. https://doi.org/10.3102/0002831215574725
26.
de ChaisemartinC.d’HaultfoeuilleX. (2020). Two-way fixed effects estimators with heterogeneous treatment effects. American Economic Review, 110(9), 2964–2996. https://doi.org/10.3386/w25904
27.
de ReeJ.MuralidharanK.PradhanM.RogersH. (2017). Double for nothing? Experimental evidence on an unconditional teacher salary increase in Indonesia. The Quarterly Journal of Economics, 133(2), 993–1039. https://doi.org/10.5040/9781474209700.0002
28.
DresslerC. A. (2000). The word-inferencing strategies of bilingual and monolingual fifth graders: A case study approach [Unpublished doctoral dissertation]. Harvard Graduate School of Education.
29.
DurgunoğluA. Y.NagyW. E.Hancin-BhattB. J. (1993). Cross-language transfer of phonological awareness. Journal of Educational Psychology, 85(3), 453–465. https://doi.org/10.1037/0022-0663.85.3.453
30.
EchevarriaJ.VogtM.ShortD. (2008). Making content comprehensible for English learners: The SIOP model. Pearson.
Faulkner-BondM.SireciS. G. (2015). Validity issues in assessing linguistic minorities. International Journal of Testing, 15(2), 114–135. https://doi.org/10.1080/15305058.2014.974763
33.
FlodenR.StephensA.SchererL. (2020). Changing expectations for the K–12 teacher workforce: Policies, preservice education, professional development, and the workplace [Consensus study report]. National Academies Press.
34.
FriedmanJ.HastieT.TibshiraniR. (2001). The elements of statistical learning. Springer.
GarcíaG. E. (1991). Factors influencing the English reading test performance of Spanish-speaking Hispanic children. Reading Research Quarterly, 26(4), 371–392. https://doi.org/10.2307/747894
37.
GlazermanS.SeifullahA. (2010). An evaluation of the Teacher Advancement Program (TAP) in Chicago: Year two impact report. Mathematica Policy Research. https://files.eric.ed.gov/fulltext/ED530098.pdf
38.
GoldhaberD.AnthonyE. (2007). Can teacher quality be effectively assessed? National Board Certification as a signal of effective teaching. The Review of Economics and Statistics, 89(1), 134–150. https://doi.org/10.1162/rest.89.1.134
39.
GoldhaberD.WalchJ. (2012). Strategic pay reform: A student outcomes-based evaluation of Denver’s ProComp teacher pay initiative. Economics of Education Review, 31(6), 1067–1083. https://doi.org/10.1016/j.econedurev.2012.06.007
Goodman-BaconA. (2018). Difference-in-differences with variation in treatment timing. National Bureau of Economic Research. https://www.nber.org/papers/w25018
Hancin-BhattB.NagyW. (1994). Lexical transfer and second language morphological development. Applied Psycholinguistics, 15(3), 289–310. https://doi.org/10.1017/s0142716400065905
44.
HarklauL.YangA. H. (2019). Educators’ construction of mainstreaming policy for English learners: A decision-making theory perspective. Language Policy, 19, 87–110. https://doi.org/10.1007/s10993-019-09511-6
45.
HarrisD. N.SassT. R. (2011). Teacher training, teacher quality and student achievement. Journal of Public Economics, 95(7–8), 798–812. https://doi.org/10.1016/j.jpubeco.2010.11.009
JacobB. A.LefgrenL. (2004). Remedial education and student achievement: A regression-discontinuity analysis. Review of Economics and Statistics, 86(1), 226–244. https://doi.org/10.1162/003465304323023778
48.
JiménezR. T.GarcíaG. E.PearsonP. D. (1996). The reading strategies of bilingual Latina/o students who are successful English readers: Opportunities and obstacles. Reading Research Quarterly, 31(1), 90–112. https://doi.org/10.1598/rrq.31.1.5
49.
JonesN. D.BellC. A.BrownellM.QiY.PeytonD.PuaD.HoltzmanS. (2022). Using classroom observations in the evaluation of special education teachers. Educational Evaluation and Policy Analysis, 44(3), 429–457.
50.
KennedyM. M. (2016). How does professional development improve teaching?Review of Educational Research, 86(4), 945–980. https://doi.org/10.3102/0034654315626800
51.
KiefferM. J.LesauxN. K.RiveraM.FrancisD. J. (2009). Accommodations for English language learners taking large-scale assessments: A meta-analysis on effectiveness and validity. Review of Educational Research, 79(3), 1168–1201. https://doi.org/10.3102/0034654309332490
52.
KiefferM. J.ThompsonK. D. (2018). Hidden progress of multilingual students on NAEP. Educational Researcher, 47(6), 391–398. https://doi.org/10.3102/0013189x18777740
53.
KraftM. A.BlazarD.HoganD. (2018). The effect of teacher coaching on instruction and achievement: A meta-analysis of the causal evidence. Review of Educational Research, 88(4), 547–588. https://doi.org/10.3102/0034654318759268
54.
KraftM. A.PapayJ. P.ChiO. L. (2020). Teacher skill development: Evidence from performance ratings by principals. Journal of Policy Analysis and Management, 39(2), 315–347. https://doi.org/10.1002/pam.22193
55.
LaneS.LeventhalB. (2015). Psychometric challenges in assessing English language learners and students with disabilities. Review of Research in Education, 39(1), 165–214. https://doi.org/10.3102/0091732x14556073
56.
LoebS.SolandJ.FoxL. (2014). Is a good teacher a good teacher for all? Comparing value-added of teachers with their English learners and non-English learners. Educational Evaluation and Policy Analysis, 36(4), 457–475. https://doi.org/10.3102/0162373714527788
57.
LópezF.ScanlanM.GundrumB. (2013). Preparing teachers of English language learners: Empirical evidence and policy implications. Education Policy Analysis Archives, 21(20), 1–31. https://doi.org/10.14507/epaa.v21n20.2013
58.
LoyalkaP.PopovaA.LiG.ShiZ. (2019). Does teacher training actually work? Evidence from a large-scale randomized evaluation of a national teacher training program. American Economic Journal: Applied Economics, 11(3), 128–154. https://doi.org/10.1257/app.20170226
59.
LuM.LoyalkaP.ShiY.ChangF.LiuC.RozelleS. (2019). The impact of teacher professional development programs on student achievement in rural China: Evidence from Shaanxi Province. Journal of Development Effectiveness, 11(2), 105–131. https://doi.org/10.1080/19439342.2019.1624594
60.
LynchK.HillH. C.GonzalezK. E.PollardC. (2019). Strengthening the research base that informs stem instructional improvement efforts: A meta-analysis. Educational Evaluation and Policy Analysis, 41(3), 260–293. https://doi.org/10.3102/0162373719849044
61.
MartinielloM. (2009). Linguistic complexity, schematic representations, and differential item functioning for English language learners in math tests. Educational Assessment, 14(3–4), 160–179. https://doi.org/10.1080/10627190903422906
MasterB.LoebS.WhitneyC.WyckoffJ. (2016). Different skills? Identifying differentially effective teachers of English language learners. The Elementary School Journal, 117(2), 261–284. https://doi.org/10.1086/688871
65.
MatsumuraL. C.GarnierH. E.ResnickL. B. (2010). Implementing literacy coaching: The role of school social resources. Educational Evaluation and Policy Analysis, 32(2), 249–272. https://doi.org/10.3102/0162373710363743
OtheguyR.GarcíaO.ReidW. (2015). Clarifying translanguaging and deconstructing named languages: A perspective from linguistics. Applied Linguistics Review, 6(3), 281–307. https://doi.org/10.1515/applirev-2015-0014
68.
PapayJ. P.TaylorE. S.TylerJ. H.LaskiM. E. (2020). Learning job skills from colleagues at work: Evidence from a field experiment using teacher performance data. American Economic Journal: Economic Policy, 12(1), 359–388. https://doi.org/10.1257/pol.20170709
69.
Penner-WilliamsJDíazE. I.WorthenD. G. (2017). PLCs: Key PD component in learning transfer for teachers of English learners. Teaching and Teacher Education, 65, 215–229. https://doi.org/10.1016/j.tate.2017.03.014
70.
RobinsonJ. P. (2010). The effects of test translation on young English learners’ mathematics performance. Educational Researcher, 39(8), 582–590. https://doi.org/10.3102/0013189x10389811
71.
RotermundS.DeRocheJ.OttemR. (2017). Teacher professional development by selected teacher and school characteristics: 2011–12 (Stats in brief. NCES 2017-200). National Center for Education Statistics. https://nces.ed.gov/pubs2017/2017200.pdf
72.
SantagataR.KerstingN.GivvinK. B.StiglerJ. W. (2010). Problem implementation as a lever for change: An experimental study of the effects of a professional development program on students’ mathematics learning. Journal of Research on Educational Effectiveness, 4(1), 1–24. https://doi.org/10.1080/19345747.2010.498562
73.
SassT. R. (2015). Licensure and worker quality: A comparison of alternative routes to teaching. The Journal of Law and Economics, 58(1), 1–35. https://doi.org/10.1086/682904
74.
SaundersW. M.MarcellettiD. J. (2013). The gap that can’t go away: The catch-22 of reclassification in monitoring the progress of English learners. Educational Evaluation and Policy Analysis, 35(2), 139–156. https://doi.org/10.3102/0162373712461849
Staehr FennerD. (2013, February). Implementing the common core state standards for English learners: The changing role of the ESL teacher [Proceedings]. TESOL International Association, Alexandria, VA, United States.
77.
TaylorE. S.TylerJ. H. (2012). The effect of evaluation on teacher performance. American Economic Review, 102(7), 3628–3651. https://doi.org/10.1257/aer.102.7.3628
78.
UmanskyI. M.ThompsonK. DDíazG. (2017). Using an ever–English learner framework to examine disproportionality in special education. Exceptional Children, 84(1), 76–96. https://doi.org/10.1177/0014402917707470
79.
UmanskyI. M.ValentinoR. A.ReardonS. F. (2016). The promise of two-language education. Educational Leadership, 73(5), 10–17.
80.
U.S. Department of Education. (2018). Educational experiences of English learners: Access to and enrollment in early learning programs, advanced coursework, and dual credit programs. https://www2.ed.gov/datastory/el-experiences/index.html
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
