Need-Based Promise Programs,Performance Funding Bonuses,and the Enrollment of Low-Income Students

Abstract

Certain statewide promise programs require students to demonstrate financial need, while state performance funding policies sometimes incorporate a financial bonus that incentivizes colleges to enroll or graduate low-income students. We use data on public, 4-year colleges from 2007–2008 to 2019–2020, and incorporate difference-in-differences analyses and event studies. We find that colleges affected by promise programs in Louisiana, New York, and Washington observed no changes to the number and percent of first-time, full-time (FTFT) Pell grant recipients. Colleges in states subject to a performance funding bonus experienced no changes to the number and percent of FTFT Pell grants recipients, and colleges in Louisiana subject to both policies experienced no changes to either outcome.

Keywords

higher education student financial aid accountability college access

Get full access to this article

View all access options for this article.

References

Abadie

(2021). Using synthetic controls: Feasibility, data requirements, and methodological aspects. Journal of Economic Literature, 59(2), 391–425. https://doi.org/10.1257/jel.20191450

Abraham

K. G.

Clark

M. A.

(2006). Financial aid and students’ college decisions: Evidence from the District of Columbia tuition assistance grant program. Journal of Human Resources, 41(3), 578–610. https://doi.org/10.3386/w10112

Alon

(2011). Who benefits most from financial aid? The heterogeneous effect of need-based grants on students’ college persistence^*. Social Science Quarterly, 92(3), 807–829. https://doi.org/10.1111/j.1540-6237.2011.00793.x

Angrist

J. D.

Pischke

J. S.

(2009). Mostly harmless econometrics: An empiricist’s companion. Princeton University Press.

Athey

Imbens

G. W.

(2022). Design-based analysis in difference-in-differences settings with staggered adoption. Journal of Econometrics, 226(1), 62–79. https://doi.org/10.1016/j.jeconom.2020.10.012

Banta

T. W.

Rudolph

L. B.

Dyke

J. V.

Fisher

H. S.

(1996). Performance funding comes of age in Tennessee. Journal of Higher Education, 67(1), 23–45.

Bartik

T. J.

Hershbein

Lachowska

(2021). The effects of the Kalamazoo Promise scholarship on college enrollment and completion. Journal of Human Resources, 56(1), 269–310. https://doi.org/10.3368/jhr.56.1.0416-7824r4

Bell

Fryar

A. H.

Hillman

(2018). When intuition misfires: A meta-analysis of research on performance-based funding in higher education. In Hazelkorn

McCormick

Coates

(Eds.), Research handbook on quality, performance and accountability (pp. 108–124). Edward Elgar Publishing.

Bettinger

E. P.

Long

B. T.

Oreopoulos

Sanbonmatsu

(2012). The role of application assistance and information in college decisions: Results from the H&R Block FAFSA experiment. Quarterly Journal of Economics, 127(3), 1205–1242. https://doi.org/10.1093/qje/qjs017

10.

Bifulco

Rubenstein

Sohn

(2019). Evaluating the effects of universal place-based scholarships on student outcomes: The Buffalo “say yes to education” program. Journal of Policy Analysis and Management, 38(4), 918–943. https://doi.org/10.1002/pam.22139

11.

Billings

(2018, September 18). Understanding the design of college promise programs, and where to go from here. Brookings Institution. https://www.brookings.edu/articles/understanding-the-design-of-college-promise-programs-and-where-to-go-from-here/

12.

Billings

M. S.

Gándara

A. Y.

(2021). Tuition-free promise programs: Implications and lessons learned. New Directions for Community Colleges, 2021(196), 81–95. https://doi.org/10.1002/cc.20485

13.

Birdsall

(2018). Performance management in public higher education: Unintended consequences and the implications of organizational diversity. Public Performance & Management Review, 41(4), 669–695. https://doi.org/10.1080/15309576.2018.1481116

14.

Blankenberger

Phillips

(2016). Performance funding in Illinois higher education: The roles of politics, budget environment, and individual actors in the process. Educational Policy, 30(6), 884–915. https://doi.org/10.1177/0895904814556748

15.

Boggs

B. G.

(2019). A promise is a promise: Free tuition programs and how they work. National Conference of State Legislatures. https://wyoleg.gov/InterimCommittee/2019/S15-20190730NCSLFree-Tuition-Programs_v03.pdf

16.

Callaway

Sant’Anna

P. H. C.

(2021). Difference-in-differences with multiple time periods. Journal of Econometrics, 225(2), 200–230. https://doi.org/10.1016/j.jeconom.2020.12.001

17.

Campaign for Free College Tuition. (n.d). Promise programs. Retrieved August 5, 2023, from https://www.freecollegenow.org/promise_programs

18.

Chakrabarti

Gorton

Lovenheim

(2020). State investment in higher education: Effects on human capital formation, student debt, and long-term financial outcomes of students. Federal Reserve Bank of New York Staff Report 941.

19.

Clarke

Tapia-Schythe

(2021). Implementing the panel event study. The Stata Journal: Promoting Communications on Statistics and Stata, 21(4), 853–884. https://doi.org/10.1177/1536867x211063144

20.

College Promise. (2021). College promise catalog of local and state programs. https://www.collegepromise.org/resources

21.

Daugherty

Gonzalez

G. C.

(2016). The impact of the New Haven Promise program on college enrollment, choice, and persistence. Working Paper No. 1146. RAND Corporation. https://www.rand.org/pubs/working_papers/WR1147.html

22.

Dougherty

K. J.

Jones

S. M.

Lahr

Natow

R. S.

Pheatt

Reddy

(2016). Performance funding for higher education. Johns Hopkins University Press.

23.

Dougherty

K. J.

Reddy

(2013). Performance funding for higher education: What are the mechanisms? What are the impacts? ASHE Higher Education Report, 39(2), 1–135.

24.

Dynarski

Libassi

Michelmore

Owen

(2021). Closing the gap: The effect of reducing complexity and uncertainty in college pricing on the choices of low-income students. American Economic Review, 111(6), 1721–1756. https://doi.org/10.1257/aer.20200451

25.

Dynarski

S. M.

(2003). Does aid matter? Measuring the effect of student aid on college attendance and completion. American Economic Review, 93(1), 279–288.

26.

Elliott

K. C.

Haynes

Jones

(2021). Re-imagining outcomes-based funding. The Education Trust. https://edtrust.org/resource/re-imagining-outcomes-based-funding/

27.

Gándara

(2020). Promise for whom? “Free-college” programs and enrollments by race and gender classifications at public, 2-year colleges. Educational Evaluation and Policy Analysis, 42(4), 603–627. https://doi.org/10.3102/0162373720962472

28.

Gándara

Rutherford

(2018). Mitigating unintended impacts? The effects of premiums for underserved populations in performance-funding policies for higher education. Research in Higher Education, 59(6), 681–703. https://doi.org/10.1007/s11162-017-9483-x

29.

Gándara

Rutherford

(2020). Completion at the expense of access? The relationship between performance-funding policies and access to public 4-year universities. Educational Researcher, 49(5), 321–334. https://doi.org/10.3102/0013189x20927386

30.

Goodman-Bacon

(2021). Difference-in-differences with variation in treatment timing. Journal of Econometrics, 225(2), 254–277. https://doi.org/10.1016/j.jeconom.2021.03.014

31.

Heller

D. E.

Marin

(2004). State merit scholarship programs and racial inequality. The Civil Rights Project at Harvard University. https://files.eric.ed.gov/fulltext/ED489183.pdf

32.

Hillman

N. W.

Hicklin Fryar

Crespín-Trujillo

(2018). Evaluating the impact of performance funding in Ohio and Tennessee. American Educational Research Journal, 55(1), 144–170. https://doi.org/10.3102/0002831217732951

33.

Imai

Kim

I. S.

Wang

E. H.

(2023). Matching methods for causal inference with time-series cross-sectional data. American Journal of Political Science, 67(3), 587–605. https://doi.org/10.1111/ajps.12685

34.

Kelchen

(2018). Do performance-based funding policies affect underrepresented student enrollment? Journal of Higher Education, 89(5), 702–727. https://doi.org/10.1080/00221546.2018.1434282

35.

Kofoed

M. S.

(2017). To apply or not to apply: FAFSA completion and financial aid gaps. Research in Higher Education, 58(1), 1–39. https://doi.org/10.1007/s11162-016-9418-y

36.

Davidson

James

Ward

Margolis

Research

Booth

(2020). Policies to ensure equitable access to well-resourced colleges and universities. Ithaka S+R. https://sr.ithaka.org/publications/access-to-well-resourced-colleges-and-universities/

37.

A. Y.

(2019). The weight of the metric: Performance funding and the retention of historically underserved students. Journal of Higher Education, 90(6), 965–991. https://doi.org/10.1080/00221546.2019.1602391

38.

A. Y.

(2021). Four decades of performance funding and counting. In Perna

L. W.

(Ed.), Higher education: Handbook of theory and research (Vol. 36, pp. 1–64). Springer.

39.

A. Y.

Gándara

(2020). The promise of “free” tuition and program design features: Impacts on first-time college enrollment. In Perna

L. W.

Smith

E. J.

(Eds.), Improving research-based knowledge of college promise programs (pp. 219–239). American Educational Research Association.

40.

A. Y.

Ortagus

J. C.

(2019). Raising the stakes: Impacts of the complete college Tennessee Act on underserved student enrollment and sub-baccalaureate credentials. Review of Higher Education, 43(1), 295–333. https://doi.org/10.1353/rhe.2019.0097

41.

Louisiana Board of Regents. (2018). Louisiana’s performance funding formula. https://regents.la.gov/wp-content/uploads/2018/03/4c-Outcomes-Based-Funding-Formula-Overview.pdf

42.

Louisiana Office of Student Financial Assistance. (2024). GO grant. https://mylosfa.la.gov/students-parents/scholarships-grants/go-grant/

43.

Lowry

A.Y.

(2022). How do college promise programs benefit students? Messaging. In Miller-Adams

Iriti

, (Eds.), The free college handbook (Ch. 5). The Upjohn Institute. https://www.freecollegehandbook.com/5-how-do-promise-programs-benefit-students-messaging

44.

Miller-Adams

(2015). Promise nation: Transforming communities through place-based scholarships. W.E. Upjohn Institute for Employment Research. http://research.upjohn.org/up_press/235/

45.

Mishory

(2018). The future of statewide college promise programs. A state guide to free college. The Century Foundation. https://tcf.org/content/report/future-statewide-college-promise-programs/

46.

Monks

(2018). Institutional variation in enrollment of low-income students. Journal of Student Financial Aid, 48(1), 53–70.

47.

New York State. (n.d). Tuition-free degree program: The excelsior scholarship. https://www.ny.gov/programs/tuition-free-degree-program-excelsior-scholarship

48.

Nguyen

(2019). Free tuition and college enrollment: Evidence from New York’s excelsior program. Education Economics, 27(6), 573–587. https://doi.org/10.1080/09645292.2019.1652727

49.

Odle

T. K.

(2022). The power of “free” college: Reducing racial and socioeconomic inequalities in college expectations. EdWorkingPaper No. 22-565. Annenberg Institute at Brown University. https://doi.org/10.26300/0wkw-wd50

50.

Ortagus

J. C.

Kelchen

Rosinger

Voorhees

(2020). Performance-based funding in American higher education: A systematic synthesis of the intended and unintended consequences. Educational Evaluation and Policy Analysis, 42(4), 520–550. https://doi.org/10.3102/0162373720953128

51.

Ortagus

J. C.

Rosinger

Kelchen

(2021). InformEd States performance-based funding policies dataset. InformEd States. https://informedstates.org

52.

Page

L. C.

Scott-Clayton

(2016). Improving college access in the United States: Barriers and policy responses. Economics of Education Review, 51, 4–22. https://doi.org/10.1016/j.econedurev.2016.02.009

53.

Palmer

(2023, November 1). In “buyer’s market,’ tuition increases haven’t outpaced tuition. Inside Higher Ed. https://www.insidehighered.com/news/students/financial-aid/2023/11/01/buyers-market-tuition-increases-havent-outpaced-inflation

54.

Perna

L. W.

(2006). Understanding the relationship between information about college prices and financial aid and students’ college-related behaviors. American Behavioral Scientist, 49(12), 1620–1635. https://doi.org/10.1177/0002764206289144

55.

Perna

L. W.

Leigh

E. W.

(2020). Database of college promise programs. University of Pennsylvania, Alliance for Higher Education and Democracy. https://ahead-penn.org/creating-knowledge/college-promise

56.

Perna

L. W.

Wright-Kim

Leigh

E. W.

(2020). Is a college promise program an effective use of resources? Understanding the implications of program design and resource investments for equity and efficiency. AERA Open, 6(4), 1–15. https://doi.org/10.1177/2332858420967633

57.

Pinkard

Weeden

LaBruyere

Collins

C. L.

(2022). The higher education funding formula review process: Best practices. New Directions for Higher Education, 2022(198), 101–112. https://doi.org/10.1002/he.20445

58.

Roksa

Kinsley

(2019). The role of family support in facilitating academic success of low-income students. Research in Higher Education, 60(4), 415–436. http://www.jstor.org/stable/45180388

59.

Rutherford

Rabovsky

(2014). Evaluating impacts of performance funding policies on student outcomes in higher education. Annals of the American Academy of Political and Social Science, 655(1), 185–208. https://doi.org/10.1177/0002716214541048

60.

Sant’Anna

P. H. C.

Zhao

(2020). Doubly robust difference-in-differences estimators. Journal of Econometrics, 219(1), 101–122. https://doi.org/10.1016/j.jeconom.2020.06.003

61.

Smalley

(2024, February 22). Innovative postsecondary funding strategies. National Conference of State Legislatures. https://www.ncsl.org/education/innovative-postsecondary-funding-strategies

62.

Sun

Abraham

(2021). Estimating dynamic treatment effects in event studies with heterogeneous treatment effects. Journal of Econometrics, 225(2), 175–199. https://doi.org/10.1016/j.jeconom.2020.09.006

63.

Vargas

Dancy

(2023, August 16). College affordability still out of reach for students with lowest incomes, students of color. Institute for Higher Education Policy. https://www.ihep.org/college-affordability-still-out-of-reach-for-students-with-lowest-incomes-students-of-color/

64.

Washington Student Achievement Council. (2024a). Washington college grant. https://wsac.wa.gov/wcg

65.

Washington Student Achievement Council. (2024b). College bound. https://wsac.wa.gov/college-bound

66.

W.E. Upjohn Institute. (2023). Promise research at the Upjohn Institute. https://www.upjohn.org/promise/index.html#promiseDef

67.

(2017). Generalized synthetic control method: Causal inference with interactive fixed effects models. Political Analysis, 25(1), 57–76. https://doi.org/10.1017/pan.2016.2

68.

Zhao

(2018). Disinvesting in the future? A comprehensive examination of the effects of state appropriations for public higher education. Federal Reserve Bank of Boston, New England Public Policy Center.