The COVID-19 pandemic caused large, persistent declines in student achievement. This paper examines 2022–2023 recovery efforts across eight districts, including tutoring, small-group instruction, after-school, extended year, double-dose, digital learning, and expert teacher interventions. The study includes 12 math programs and 15 literacy programs (three covered both subjects). Most served fewer students and provided lower dosage than planned. Using value-added models, we find positive, robust effects in just five subject-intervention pairs: one subject-specific tutoring program (+0.22 SD math, +0.22 SD reading), a small-group reading intervention (+0.33 SD), and assignment to “expert” teachers (+0.06 SD math, +0.11 SD reading). Results highlight the promise of intensive interventions while underscoring the difficulty of scaling them to meet recovery needs.
AbadieA.AtheyS.ImbensG. W.WooldridgeJ. M. (2023). When should you adjust standard errors for clustering?. The Quarterly Journal of Economics, 138(1), 1–35.
2.
ArthurA. M.DavisD. L. (2016). A pilot study of the impact of double-dose robust vocabulary instruction on children’s vocabulary growth. Journal of Research on Educational Effectiveness, 9(2), 173–200.
3.
BarryS. S.SassT. R. (2022). The impact of a 2021 Summer School Program on student achievement. Georgia Policy Labs. https://doi.org/10.57709/FAJ9-8597
4.
BettingerE.FairlieR.KapuzaA.KardanovaE.LoyalkaP.ZakharovA. (2023). Diminishing marginal returns to computer-assisted learning. Journal of Policy Analysis and Management, 42(2), 552–570.
5.
BhattM. P.GuryanJ.KhanS. A.LaForest-TuckerM.MishraB. (2024). Can technology facilitate scale? Evidence from a randomized evaluation of high dosage tutoring (NBER Working Paper No. w32510). National Bureau of Economic Research.
6.
CallenI.CarbonariM. V.DeArmondM.DeweyD.Dizon-RossE.GoldhaberD.IsaacsJ.KaneT. J.KuhfeldM.McDonaldA.McEachinA.MortonE.MurogaA.StaigerD. O. (2023). Summer school as a learning loss recovery strategy after COVID-19: Evidence from Summer 2022 (Working Paper No. 291-0823). National Center for Analysis of Longitudinal Data in Education Research (CALDER).
7.
CarbonariM. V.DavisonM.DeArmondM.DeweyD.Dizon-RossE.GoldhaberD.HashimA.KaneT. J.McEachinA.MortonE.MurogaA.PattersonT.StaigerD. O. (2024). The challenges of implementing academic COVID recovery interventions: Evidence from the Road to Recovery Project (Working Paper No. 275-0624-2). National Center for Analysis of Longitudinal Data in Education Research (CALDER).
8.
CheckowayA.GamseB.VelezM.LinkowT. (2013). Evaluation of the Massachusetts expanded learning time (ELT) initiative: Final study findings. Society for Research on Educational Effectiveness.
9.
CortesK.KortecampK.LoebS.RobinsonC. (2025). A scalable approach to high-impact tutoring for young readers. Learning and Instruction, 95, 102021.
DeweyD.FahleE.KaneJ.ReardonS.StaigerD. (2024). Federal pandemic relief and academic recovery. Center for Education Policy Research at Harvard University.
DotyE.KaneT. J.PattersonT.StaigerD. O. (2022). What do changes in state test scores imply for later life outcomes? (NBER Working Paper No. 30701). National Bureau of Economic Research.
16.
EscuetaM.QuanV.NickowA. J.OreopoulosP. (2017). Education technology: An evidence-based review (NBER Working Paper No. 23744). National Bureau of Economic Research.
17.
FahleE. M.KaneT. J.PattersonT.ReardonS. F.StaigerD. O.StuartE. A. (2023). School district and community factors associated with learning loss during the COVID-19 pandemic. Center for Education Policy Research at Harvard University.
18.
FahleE. M.KaneT. J.ReardonS. F.StaigerD. O. (2024). The first year of pandemic recovery: A district-level analysis. Center for Education Policy Research at Harvard University.
19.
GoldhaberD.FalkenG. (2024). ESSER and student achievement: Assessing the impacts of the largest one-time federal investment in K12 schools (CALDER Working Paper No. 301-0624). National Center for Analysis of Longitudinal Data in Education Research (CALDER).
20.
GoldhaberD.KaneT. J.McEachinA.MortonE.PattersonT.StaigerD. O. (2023). The educational consequences of remote and hybrid instruction during the pandemic. American Economic Review: Insights, 5(3), 377–392.
21.
HahnJ.ToddP.Van der KlaauwW. (2001). Identification and estimation of treatment effects with a regression-discontinuity design. Econometrica, 69(1), 201–209.
HillH. C.EricksonA. (2019). Using implementation fidelity to aid in interpreting program impacts: A brief review. Educational Researcher, 48(9), 590–598.
JacobB. A.LefgrenL. (2009). The effect of grade retention on high school completion. American Economic Journal: Applied Economics, 1(3), 33–58.
27.
KimJ. S.QuinnD. M. (2013). The effects of summer reading on low-income children’s literacy achievement from Kindergarten to Grade 8: A meta-analysis of classroom and home interventions. Review of Educational Research, 83(3), 386–431.
28.
KohlmoosL.SteinbergM. P. (2024). Contextualizing the impact of tutoring on student learning: Efficiency, cost effectiveness, and the known unknowns [Research report] Accelerate. https://accelerate.us/efficiency-and-cost-effectiveness
29.
KraftM. A. (2015). How to make additional time matter: Integrating individualized tutorials into an extended day. Education Finance and Policy, 10(1), 81–116.
30.
KraftM. A. (2020). Interpreting effect sizes of education interventions. Educational Researcher, 49(4), 241–253.
31.
KraftM. A.EdwardsD. S.CannataM. (2024). The scaling dynamics and causal effects of a district-operated tutoring program (EdWorkingPaper No. 24-1030). Annenberg Institute at Brown University. https://doi.org/10.26300/zcw7-4547
32.
KraftM. A.SchuelerB. E.FalkenG. (2024). What impacts should we expect from tutoring at scale? Exploring meta-analytic generalizability (EdWorkingPaper No. 24-1031). Annenberg Institute at Brown University. https://edworkingpapers.com/ai24-1031
33.
KraftM. A.LovisonV. S. (2024). The effect of student-tutor ratios: Experimental evidence from a Pilot Online Math Tutoring Program (EdWorkingPaper No. 24-976.) Annenberg Institute at Brown University.
34.
KraftM. A.NovicoffS. (2024). Time in school: A conceptual framework, synthesis of the causal research, and empirical exploration. American Educational Research Journal, 61(4), 724–766.
35.
KuhfeldM.DilibertiM.McEachinA.SchweigJ.MarianoL. T. (2023). Typical learning for whom? Guidelines for selecting benchmarks to calculate months of learning (Research brief). NWEA.
36.
LewisK.KuhfeldM. (2022). Progress toward pandemic recovery: Continued signs of rebounding achievement at the start of the 2022–23 school year (Research brief). NWEA.
37.
LewisK.KuhfeldM. (2023). Education’s long COVID: 2022–23 Achievement data reveal stalled progress toward pandemic recovery (Research brief). NWEA.
38.
LewisK.KuhfeldM. (2024). Recovery still elusive: 2023–24 Student achievement highlights persistent achievement gaps and a long road ahead (Research brief). NWEA.
39.
LynchK.AnL.MancenidoZ. (2023). The impact of summer programs on student mathematics achievement: A meta-analysis. Review of Educational Research, 93(2), 275–315.
40.
MakoriA.BurchP.LoebS. (2024). Scaling high-impact tutoring: School level perspectives on implementation challenges and strategies (EdWorkingPaper No. 24-932). Annenberg Institute at Brown University.
41.
McCombsJ. S.PaneJ. F.AugustineC. H.SchwartzH. L.MartorellP.ZakarasL. (2014). Ready for fall? Near-term effects of voluntary summer learning programs on low-income students’ learning opportunities and outcomes. RAND Corporation. https://doi.org/10.7249/RR815
McEachinA.AtteberryA. (2017). The impact of summer learning loss on measures of school performance. Education Finance and Policy, 12(4), 468–491.
44.
NickowA.OreopoulosP.QuanV. (2024). The promise of tutoring for PreK–12 learning: A systematic review and meta-analysis of the experimental evidence. American Educational Research Journal, 61(1), 74–107.
45.
NomiT. (2015). “Double-dose” English as a strategy for improving adolescent literacy: Total effect and mediated effect through classroom peer ability change. Social Science Research, 52, 716–739.
46.
NomiT.AllensworthE. M. (2013). Sorting and supporting: Why double-dose algebra led to better test scores but more course failures. American Educational Research Journal, 50(4), 756–788.
47.
OpperI.ÖzekU. (2024). A global regression discontinuity design: Theory and application to grade retention policies (CESifo Working Paper No. 10972.) Center for Economic Studies.
48.
OsterE. (2019). Unobservable selection and coefficient stability: Theory and evidence. Journal of Business and Economic Statistics, 37(2), 187–204.
49.
ÖzekU. (2021). The effects of middle school remediation on postsecondary success: Regression discontinuity evidence from Florida. Journal of Public Economics, 203, 104518.
50.
ÖzekU.MarianoL. T. (2023). Think again: Is grade retention bad for kids?. Thomas B. Fordham Institute.
RaudenbushS. W. (2009). Analyzing effect sizes: Random-effects models. In CooperH.HedgesL. V.ValentineJ. C. (Eds.), The handbook of research synthesis and meta-analysis (pp. 295–315). Russell Sage Foundation.
53.
ReadyD. D.McCormickS. G.ShmoysR. J. (2024). The effects of in-school virtual tutoring on student reading development: Evidence from a short-cycle randomized controlled trial (EdWorkingPaper No. 24-942). Annenberg Institute at Brown University.
54.
ReardonS. F.HoA. D.ShearB. R.FahleE. M.KalogridesD.SalibaJ. (2024). Stanford Education Data Archive (Version 5.0). The Educational Opportunity Project at Stanford University. https://purl.stanford.edu/cs829jn7849
55.
RobinsonC. D.BishtB.LoebS. (2022). The inequity of opt-in educational resources and an intervention to increase equitable access (EdWorkingPaper No. 22-654). Annenberg Institute at Brown University.
56.
SacerdoteB. (2012). When the saints go marching out: Long-term outcomes for student evacuees from Hurricanes Katrina and Rita. American Economic Journal: Applied Economics, 4(1), 109–135.
U.S. Department of Education. (2021). Education in a pandemic: The disparate impacts of COVID-19 on America’s students. U.S. Department of Education, Office of Civil Rights.
60.
U.S. Department of Education. (2022). National Assessment of Educational Progress (NAEP) 2022 long-term trend assessment results: Reading and mathematics. Institute of Education Sciences, National Center for Education Statistics. https://www.nationsreportcard.gov/highlights/ltt/2022/
61.
U.S. Department of Education. (2023). Digest of education statistics: 2023. Institute of Education Sciences, National Center for Education Statistics.
