We examine whether the El Dorado Promise, a guaranteed college scholarship program for students in the El Dorado School District (EDSD), affected elementary and middle school achievement using a quasi-experimental matching design. We first match the EDSD with similar districts to create a pool of potential comparison students then match students on prior achievement and demographics. The Promise leads to an estimated 0.11 standard deviation gain in math achievement; this effect is statistically significant and practically meaningful. Results are similar from district-level synthetic control and difference-in-differences analyses. We find larger effects on students with above-average prior achievement. We are unable to construct an appropriate comparison group to estimate the impact of the Promise on literacy achievement.
AbadieA.DiamondA.HainmuellerJ. (2010). Synthetic control methods for comparative case studies: Estimating the effect of California’s tobacco control program. Journal of the American Statistical Association, 105(490), 493–505.
AngristJ.PischkeJ. (2009). Mostly harmless econometrics: An empiricist’s companion. Princeton University Press.
4.
ArcherL.HutchingsM. (2000). “Bettering yourself?” Discourses of risk, cost and benefit in ethnically diverse, young working-class non-participants’ constructions of higher education. British Journal of Sociology of Education, 21(4), 555–574.
BartikT.EbertsR.HuangW. (2010, June16–18). The Kalamazoo Promise, and enrollment and achievement trends in Kalamazoo Public Schools [Paper presentation]. PromiseNet 2010 Conference, Kalamazoo, MI, United States. http://research.upjohn.org/confpapers/15
8.
BartikT.HershbeinB.LachowskaM. (2017, December1). The effects of the Kalamazoo Promise scholarship on college enrollment, persistence, and completion (Upjohn Institute Working Paper 15-229). http://research.upjohn.org/up_workingpapers/229
9.
BartikT.LachowskaM. (2012, August29). The short-term effects of the Kalamazoo Promise scholarship on student outcomes (Upjohn Institute Working Paper 12-186). https://doi.org/10.17848/wp12-186
10.
BozickR.GonzalezG.EngbergJ. (2015). Using a merit-based scholarship program to increase rates of college enrollment in an urban school district: The case of the Pittsburgh Promise. Journal of Student Financial Aid, 45(2), 1–24.
11.
BruceD.CarruthersC. (2014). Jackpot? The impact of lottery scholarships on enrollment in Tennessee. Journal of Urban Economics, 81, 30–44.
12.
BuftonS. (2003). The lifeworld of the university student: Habitus and social class. Journal of Phenomenological Psychology, 34(2), 207–234.
13.
CameronA.GelbachJ.MillerD. (2008). Bootstrap-based improvements for inference with clustered errors. The Review of Economics and Statistics, 90(3), 414–427.
14.
CarruthersC.FoxW. (2016). Aid for all: College coaching, financial aid, and post-secondary persistence in Tennessee. Economics of Education Review, 51(C), 97–112.
15.
ChettyR.FriedmanJ.RockoffJ. (2014). Measuring the impacts of teachers II: Teacher value-added and student outcomes in adulthood. American Economic Review, 104(9), 2633–2679.
16.
CohodesS.GoodmanJ. (2014). Merit aid, college quality, and college completion: Massachusetts’ Adams Scholarship as an in-kind subsidy. American Economic Journal: Applied Economics, 6(4), 251–285.
17.
DaughertyL.GonzalezG. (2016, April). The impact of the New Haven Promise program on college enrollment, choice, and persistence (RAND Education Working Paper No. 1146). http://www.rand.org/pubs/working_papers/WR1147.html
18.
DestinM. (2017). An open path to the future: Perceived financial resources and school motivation. The Journal of Early Adolescence, 37(7), 1004–1031.
19.
DynarskiS.HymanJ.SchanzenbachD. (2013). Experimental evidence on the effect of childhood investments on postsecondary attainment and degree completion. Journal of Policy Analysis and Management, 32(4), 692–717.
20.
EcclesJ.WigfieldA. (2020). From expectancy-value theory to situated expectancy-value theory: A developmental, social cognitive, and sociocultural perspective on motivation. Contemporary Educational Psychology, 61, 101859. https://doi.org/10.1016/j.cedpsych.2020.101859
21.
FortsonK.Verbitsky-SavitzN.KopaE.GleasonP. (2012). Using an experimental evaluation of charter schools to test whether nonexperimental comparison group methods can replicate experimental impact estimates (NCEE 2012-4019). https://ies.ed.gov/ncee/pubs/20124019/pdf/20124019.pdf
22.
GillB.FurgesonJ.ChiangH.TehB.HaimsonJ.Verbitsky-SavitzN. (2016). Replicating experimental impact estimates with nonexperimental methods in the context of control-group noncompliance. Statistics and Public Policy, 3(1), 1–11. http://dx.doi.org/10.1080/2330443X.2015.1084252
23.
GoldhaberD.ÖzekU. (2019). How much should we rely on student test achievement as a measure of success?Educational Researcher, 48(7), 479–483.
24.
GonzalezG.BozickR.DaughertyL.SchererE.SinghR.SuarezM.RyanS. (2014). Transforming an urban school system: Progress of New Haven school change and New Haven promise education reforms (2010-2013). RAND Corporation. https://www.rand.org/pubs/research_reports/RR777.html
JussimL.MadonS.ChatmanC. (1994). Teacher expectations and student achievement. In HeathL.TindaleR. S.EdwardsJ.PosavacE.BryantF.Henderson-KingE.BalcazarY.MyersJ. (Eds.), Applications of heuristics and biases to social issues (pp. 303–334). Springer.
McClellandR.GaultS. (2017). The synthetic control method as a tool to understand state policy. Urban Institute.
30.
MichelmoreK.DynarskiS. (2017). The gap within the gap: Using longitudinal data to understand income differences in educational outcomes. AERA Open, 3(1), 1–18.
31.
Miller-AdamsM. (2009). A not-so-simple gift. In Miller-AdamsM. (Ed.), The power of a promise: Education and economic renewal in Kalamazoo (pp. 1–28). W.E. Upjohn Institute for Employment Research.
32.
Miller-AdamsM. (2015). Promise nation: Transforming communities through place-based scholarships. W.E. Upjohn Institute for Employment Research. https://doi.org/10.17848/9780880995061
PageL.IritiJ.LowryD.AnthonyA. (2019). The promise of place-based investment in postsecondary access and success: Investigating the impact of the Pittsburgh Promise. Education Finance and Policy, 14(4), 572–600.
ReayD.DaviesJ.DavidM.BallS. (2001). Choices of degree or degrees of choice? Class, “race,” and the higher education choice process. Sociology, 35(4), 855–874.
37.
RitterG.AshJ. (2016). How the “promise” of a college scholarship transformed the culture in El Dorado schools. Phi Delta Kappan, 97(5), 13–19.
38.
RitterG.SwansonE. (2020). The effect of the El Dorado Promise Scholarship on higher education, K-12, and community outcomes. In PernaL.SmithE. (Eds.), Improving research-based knowledge of college promise programs (pp. 95–118). American Educational Research Association.
39.
Rubie-DaviesC. (2006). Teacher expectations and student self-perceptions: Exploring relationships. Psychology in the Schools, 43(5), 537–552.
Scott-ClaytonJ. (2011). On money and motivation: A quasi-experimental analysis of financial incentives for college achievement. Journal of Human Resources, 46(3), 614–646.
42.
ShapiroD.DundarA.HuieF.WakhunguP.BhimdiwalaA.WilsonS. (2019). Completing college: A state-level view of student completion rates (Signature Report No. 16a). National Student Clearinghouse Research Center.
43.
SwansonE.WatsonA.RitterG. (2020). Promises fulfilled? A systematic review of the impacts of college promise programs. In PernaL.SmithE. (Eds.), Improving research-based knowledge of college promise programs (pp. 33–68). American Educational Research Association.
