Limited scholarship has examined school districtwide turnaround reforms beyond the first few years of implementation or efforts to replicate successes in new contexts. We studied Massachusetts, home to a state takeover of the Lawrence school district that led to academic gains in early reform years and where state leaders attempted to replicate this success in three additional communities. We used statewide student-level data (2006–7 to 2018–19) and event study methods to estimate medium-term impacts on student outcomes. We found that improvements were largely sustained in Lawrence. We observed evidence of successful replication in the Springfield Empowerment Zone but not Holyoke or Southbridge. Cases with positive outcomes struck a unique balance between both state and local decision-making authority, suggesting that multilevel governance can provide one pathway for effective state-led school district improvement.
AbadieA. (2021). Using synthetic controls: Feasibility, data requirements, and methodological aspects. Journal of Economic Literature, 59(2), 391–425. https://doi.org/10.1257/jel.20191450
2.
AbadieA.DiamondA.HainmuellerJ. (2015). Comparative politics and the synthetic control method. American Journal of Political Science, 59(2), 495–510. https://doi.org/10.1111/ajps.12116
3.
AbadieA.DiamondA.HainmuellerJ. (2010). Synthetic control methods for comparative case studies. Journal of the American Statistical Association, 105(490), 493–505. https://doi.org/10.1198/jasa.2009.ap08746
4.
AbdulkadiroğluA.AngristJ.PathakP. (2014). Charters without lotteries. American Economic Review, 106(7), 1878–1920. https://doi.org/10.1257/aer.20150479
5.
AnziaS. F. (2014). Timing and turnout. University of Chicago Press.
6.
BackesB.CowanJ. (2019). Is the pen mightier than the keyboard? The effect of online testing on measured student achievement. Economics of Education Review, 68, 89–103. https://doi.org/10.1016/j.econedurev.2018.12.007
7.
BakerA.LarckerD.WangC. (2022). How much should we trust staggered difference-in-differences estimates?Journal of Financial Economics, 144(2), 370–395. https://doi.org/10.1016/j.jfineco.2022.01.004
8.
BerryC. R.HowellW. G. (2005). Democratic accountability in public education. In HowellW. (Ed.), Besieged: School boards and the future of education politics (pp. 150–172). Brookings Institution Press.
9.
BillmeierA.NanniciniT. (2013). Assessing economic liberalization episodes: A synthetic control approach. Review of Economics and Statistics, 95(3), 983–1001. https://doi.org/10.1162/rest_a_00324
10.
BlazarD.SchuelerB. (2023). Effective school district policies and practices. Journal of Research on Educational Effectiveness, 17(4), 647–686. https://doi.org/10.1080/19345747.2023.2269923
11.
BormanG. D.HewesG. M.OvermanL. T.BrownS. (2003). Comprehensive school reform and achievement: A meta-analysis. review of Educational Research, 73(2), 125–230. https://doi.org/10.3102/00346543073002125
12.
BrykA. S.GreenbergS.BertaniA.SebringP.TozerS. E.KnowlesT. (2023). How a city learned to improve its schools. Harvard Education Press.
13.
BurnsP. (2003). Regime theory, state government, and a takeover of urban education. Journal of Urban Affairs, 25(3), 285–303. https://doi.org/10.1111/1467-9906.00163
14.
CarrollJ. M.HarrisD.ChildsJ.TracyH.ShieldsM.Jabbar, MarshJ.OgdenK. (2023). Back to the future? From state takeover to the nation's first all-charter, district-governed school system in New Orleans. Education Research Alliance.
15.
ChinM.KaneT. J.KozakowskiW.SchuelerB. E.StaigerD. O. (2019). School district reform in Newark: Within- and between-school changes in achievement growth. ILR Review, 72(2), 323–354. https://doi.org/10.1177/0019793918774318
16.
ChingosM. M.WhitehurstG. J.GallaherM. R. (2015). School districts and student achievement. Education Finance and Policy, 10(3), 378–398. https://doi.org/10.1162/edfp_a_00167
17.
CohenD. K.MehtaJ. (2017). Why reform sometimes succeeds: Understanding the conditions that produce reforms that last. American Educational Research Journal, 54(4), 644–690. https://doi.org/10.3102/0002831217700078s
18.
CohenD. K.PeurachD.GlazerJ. L.GatesK.GoldingS. (2014). Improvement by design: The promise of better schools. University of Chicago Press.
DeeT.WyckoffJ. (2015). Incentives, selection, and teacher performance: Evidence from IMPACT. Journal of Policy Analysis and Management, 34(2), 267–297. https://doi.org/10.1002/pam.21818
21.
DesimoneL. (2002). How can comprehensive school reform models be successfully implemented?Review of Educational Research, 72(3), 433–479. https://doi.org/10.3102/00346543072003433
FriedS. (2020). State takeover: Managing emotions, policy implementation, and the support/sanction duality in the Holyoke Public Schools receivership. Harvard Educational Review, 90(1), 75–101. https://doi.org/10.17763/1943-5045-90.1.75
25.
FryerR. G.Jr. (2014). Injecting charter school best practices into traditional public schools: Evidence from field experiments. The Quarterly Journal of Economics, 129(3), 1355–1407. https://doi.org/10.1093/qje/qju011
26.
FullerB. (2022). When schools work: Pluralist politics and institutional reform in Los Angeles. Johns Hopkins University Press.
27.
GersenJ.GersenJ. E. (2011). Election timing and public policy. Quarterly Journal of Political Science, 6(2), 103–135. https://doi.org/10.1561/100.00010070
28.
GlazerJ. L.EganC. (2018). The ties that bind: Building civic capacity for the Tennessee Achievement School District. American Educational Research Journal, 55(5), 928–964. https://doi.org/10.3102/0002831218763088
29.
GreenblattA. (2018). The problem with school takeovers. Governing.
HanushekE. A.LightJ. D.PetersonP. E.TalpeyL. M.WoessmannL. (2019). Long-run trends in the U.S. SES-achievement gap. National Bureau of Economic Research. https://www.nber.org/papers/w26764
32.
HanushekE. A.LuoJ.MorganA.NguyenM.OstB.RivkinS.ShakeelA. (2023). The effects of comprehensive educator evaluation and pay reform on achievement (Annenberg Institute Working Paper No. 23-768). https://edworkingpapers.com/ai23-768
33.
HarbatkinE.McIlwainA.StrunkK. (2022). School turnaround in a pandemic. EPIC.
34.
HarrisD.LarsenM. (2022). Taken by storm: The effects of Hurricane Katrina on medium-term student outcomes in New Orleans. Journal of Human Resources, 58(5), 1608–1643. https://doi.org/10.3368/jhr.58.5.0819-10367R2
35.
HartneyM. (2021). Revitalizing local democracy. Manhattan Institute
36.
HashimS. A.KaneT. J.Kelley-KempleT.LaskiM. E.StaigerD. O. (2020). Have income-based achievement gaps widened or narrowed?National Bureau of Economic Research. https://www.nber.org/papers/w27714
37.
HenigJ. R. (2013). The end of exceptionalism in American education: The changing politics of school reform. Harvard Education Press.
38.
HenigJ. R.HulaR. C.OrrM.PedescleauxD. S. (1999). The color of school reform: Race, politics, and the challenge of urban education. Princeton University Press.
HessF.LealD. (2005). School house politics. In HowellW. (Ed.), Besieged: School boards and the future of education politics (pp. 228–253). Brookings Institution Press.
41.
HigginsB. R. H. (2022). Getting to “yes”: A case study of teacher buy-in to school improvement efforts [ProQuest LLC, Ed.D. dissertation, George Washington University].
42.
HonigM.CoburnC. (2008). Evidence-based decision making in school district central offices: Toward a policy and research agenda. Educational Policy, 22(4), 578–608. https://doi.org/10.1177/0895904807307067
HonigM. I.RaineyL. R. (2012). Autonomy and school improvement: What do we know and where do we go from here?Educational Policy (Los Altos, Calif.), 26(3), 465–495. https://doi.org/10.1177/0895904811417590
JabbarH. (2015). “Drenched in the past”: The evolution of market-oriented reforms in New Orleans. Journal of Education Policy, 30(6), 751–772. https://doi.org/10.1080/02680939.2015.1047409
47.
JacksonK. (2023). When does school autonomy improve student outcomes? (EdWorkingPaper 23-808). Annenberg Institute at Brown University.
48.
JochimA.OpalkaA. (2017). The “city of firsts” Charts a new path on turnaround. CRPE.
49.
JohnsonS. M.MariettaG.HigginsM. C.MappK. L.GrossmanA. (2015). Achieving coherence in district improvement. Harvard Education Press.
50.
KirstM.WirtF. (2009). The political dynamics of American education. McCutchan.
51.
KoganV.LavertuS.PeskowitzZ. (2021). The democratic deficit in U.S. education governance. American Political Science Review, 115(3), 1082–1089. https://doi.org/10.1017/s0003055421000162
52.
LeithwoodK.StraussT. (2008). Turnaround schools and the leadership they require. Canadian Education Association.
53.
LincoveJ. A.ValantJ.CowenJ. M. (2018). You can't always get what you want: Capacity constraints in a choice-based school system. Economics of Education Review, 67, 94–109. https://doi.org/10.1016/j.econedurev.2018.07.006
54.
MannaP.McGuinnP. (2013). Education governance for the twenty-first century. Brookings Institution Press.
55.
MasonM. L.ReckhowS. (2017). Rootless reforms? State takeovers and school governance in Detroit and Memphis. Peabody Journal of Education, 92(1), 64–75. https://doi.org/10.1080/0161956x.2016.1264813
56.
MarshJ.AllbrightT.BrownD.BulkleyK.StrunkK.HarrisD. (2021).The process and politics of educational governance change in New Orleans, Los Angeles, and Denver. American Educational Research Journal, 58(1), 107–159.
57.
McClellandR.GaultS. (2017). The synthetic control method as a tool to understand state policy. Urban–Brookings Tax Policy Center.
58.
MeyersC. V.BrandtW. C.VanGronigenB. A. (2022). State ESSA plans and comprehensive support and improvement (CSI) status. Educational Policy, 37(5), 1277–1314. https://doi.org/10.1177/08959048221087209
59.
MoeT. M. (2011). Special Interest: Teachers unions and America's public schools. Brookings Institution Press.
MorelD. (2018). Takeover: Race, education, and American democracy. Oxford University Press.
62.
MorelD.NuamahS. A. (2020). Who governs? how shifts in political power shape perceptions of local government services. Urban Affairs Review, 56(5), 1503–1528. https://doi.org/10.1177/1078087419855675
63.
Moore JohnsonS. (2021). Leaders change, policies evolve. The Lawrence public schools respond to state receivership, Act II. Harvard Education Press.
64.
Moore JohnsonS. (2017). Investing in teachers: The Lawrence public schools respond to state receivership. Harvard Education Press.
PayneC. M. (2008). So much reform, so little change. Harvard Education Press.
68.
PeurachD. J. (2011). Seeing complexity in public education. Oxford University Press.
69.
PeurachD. J.GlazerJ. (2012). Reconsidering replication: New perspectives on large-scale school improvement. Journal of Educational Change, 13(2), 155–190. https://doi.org/10.1007/s10833-011-9177-7
70.
PeurachD. J.NeumerskiC. M. (2015). Mixing metaphors: Building infrastructure for large scale school turnaround. Journal of Educational Change, 16(4), 379–420. https://doi.org/10.1007/s10833-015-9259-z
71.
PhamL. D.HenryG. T.KhoA.ZimmerR. (2020). Sustainability and maturation of school turnaround. AERA Open, 6(2), 233285842092284. https://doi.org/10.1177/2332858420922841
72.
ReddingC.NguyenT. D. (2020). The relationship between school turnaround and student outcomes: A meta-analysis. Educational Evaluation and Policy Analysis, 42(4), 493–519. https://doi.org/10.3102/0162373720949513
73.
RiceJ. K.MalenB. (2010). School reconstitution as an education reform strategy. National Education Association.
74.
Sanderson EdwardsD.KraftM.ChristianA.CandelariaC. (2022). Teacher shortages: A unifying framework for understanding and predicting vacancies (EdWorkingPaper No. 22-684). https://edworkingpapers.com/ai22-684
75.
SchuelerB. E. (2024). Centralization and long-term system performance: Evidence from state takeovers of school districts. Public Research Quarterly, 78(2), 453–467. https://doi.org/10.1177/10659129241304096
76.
SchuelerB. E. (2019). A third way: The politics of school district takeover and turnaround in Lawrence, Massachusetts. Educational Administration Quarterly, 55(1), 116–153. https://doi.org/10.1177/0013161x18785873
77.
SchuelerB. E. (2018). Making the most of school vacation: A field experiment of small group math instruction. Education Finance and Policy, 15(2), 310–331. https://doi.org/10.1162/edfp_a_00269
78.
SchuelerB. E.BleibergJ. F. (2022). Evaluating education governance: Does state takeover of school districts affect student achievement?Journal of Policy Analysis and Management, 41(1), 162–192. https://doi.org/10.1002/pam.22338
79.
SchuelerB. E.GoodmanJ. S. (2017). Can states take over and turn around school districts? Evidence from Lawrence, Massachusetts. Educational Evaluation and Policy Analysis, 39(2), 1–24. https://doi.org/10.3102/0162373716685824
SchuelerB. E.AsherC. A.LarnedK. E.MehrotraS.PollardC. (2021). Improving low-performing schools. American Educational Research Journal, 59(5), 1–36. https://doi.org/10.3102/00028312211060855
82.
SchwartzN.KangH.LoebS.GrissomJ.BartanenB.CheathamJ.ChiO.DonaldsonM.LemosR. F.MellonG.MoffittS.NurshatayevaA.OwensJ.PinkerE.WhiteR.ZimmermanS. (2023). Studying the superintendency: A call for research. Annenberg Institute at Brown University. https://annenberg.brown.edu/publications/studying-superintendency-call-research
83.
ShoresK. A.CandelariaC. A.KabourekS. E. (2023). Spending more on the poor?Education Finance and Policy, 18(3), 395–422. https://doi.org/10.1162/edfp_a_00360
WelshR. O.WilliamsS.LittleS.GrahamJ. (2020). Examining the narrative: An analysis of the racial discourse embedded in state takeover. Equity & Excellence in Education, 52(4), 1–25. https://doi.org/10.1080/10665684.2019.1691958
90.
WongK. K.ShenF. X. (2003). Measuring the effectiveness of city and state takeover as a school reform strategy. Peabody Journal of Education, 78(4), 89–119. https://www.jstor.org/stable/1492958
91.
ZavadskyH. (2013). Scaling turnaround: A district-improvement approach. American Enterprise Institute for Public Policy Research.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
