Bridge of Promise: Comparing the Academic Outcomes of Kalamazoo Promise to Public School Students in a 4-Year Institution

Abstract

This study compares Kalamazoo Promise (KPromise) students to non-Promise, public high school graduating students at a 4-year institution. The final sample for this study was N=9,969; n = 310 (3%) were KPromise students. Descriptive analysis suggests that KPromise students were racially more diverse and less affluent than non-Promise students. Unweighted regressions show that being a KPromise student was correlated with lower college GPA, increased chance of Academic Dismissal, and lowered likelihood of Degree Attainment. Weighting the sample using Inverse Probability Weighing with Regression Adjustment (IPWRA), being a KPromise student was not correlated to any examined outcomes. However, we were unable to generate a suitably similar comparison sample with the variables we could access. Overall, the Kalamazoo Promise allows students to access the university who are so different from the comparison population that it interferes with standard approaches to assessing outcomes. Discussion centers on descriptive differences and highlights the need for better student-level data.

Keywords

#FreeCollege Kalamazoo Promise college outcomes inverse probability weighting with regression adjustment degree attainment

Get full access to this article

View all access options for this article.

References

Agresti

(2007). Categorical data analysis. John Wiley & Sons, Inc.

Austin

P.C.

(2011). An introduction to propensity score methods for reducing the effects of confounding in observation studies. Multivariate Behavioral Research, 46(3), 399–424. https://doi.org/10.1080/00273171.2011.568786

Bartik

T. J.

Hershbein

(2018). Pre-K in the public schools: Evidence from within all states (No. 18-285). W.E. Upjohn Institute. https://research.W.E.Upjohn.org/cgi/viewcontent.cgi?article = 1303&context = up_workingpapers

Bartik

T. J.

Hershbein

B. J.

Lachowska

(2019). The effects of the Kalamazoo Promise Scholarship on college enrollment and completion. The Journal of Human Resources. Advance online publication. https://doi.org/10.3368/jhr.56.1.0416-7824R4

Bartik

T. J.

Lachowska

(2012). The short-term effects of the Kalamazoo Promise scholarship on student outcomes (No. 12-186). W.E. Upjohn Institute. http://research.W.E.Upjohn.org/cgi/viewcontent.cgi?article = 1203&context = up_workingpapers

Bartik

T. J.

Sotherland

(2015). Migration and housing prices effects on place-based college scholarships (No. 15-245). W.E. Upjohn Institute. http://research.W.E.Upjohn.org/cgi/viewcontent.cgi?article = 1263&context = up_workingpapers

Becker

G. S.

(1962). Investment in human capital: A theoretical analysis. Journal of Political Economy, 70(9), 9–49. https://doi.org/10.1086/258724

Becker

G. S.

(1993). Human capital: A theoretical and empirical analysis, with special reference to education (3rd ed.). University of Chicago Press.

Belasco

A. S.

Trivette

M. J.

(2015). Aiming low: Estimating the scope and predictors of postsecondary undermatch. The Journal of Higher Education, 86(2), 233–263. https://doi.org/10.1353/jhe.2015.0008

10.

Belfield

Jenkins

Lahr

(2016). Momentum: The academic and economic value of a 15-credit first-semester coarse load for college students in Tennessee (No. 88). Columbia University. https://ccrc.tc.columbia.edu/media/k2/attachments/momentum-15-credit-course-load.pdf

11.

Biglan

(1973). The characteristics of subject matter in difference academic areas. Journal of Applied Psychology, 57(3), 195–203. https://doi.org/10.1037/h0034701

12.

Bishaw

Posey

K. G.

(2016). A comparison of rural and urban America: Household income and poverty. United States Census Bureau. https://www.census.gov/newsroom/blogs/random-samplings/2016/12/a_comparison_of_rura.html

13.

Boudon

(2009). Rational choice theory. In Turner

B. S.

(Ed.), Social theory (pp. 179–195). Blackwell Publishing Ltd. https://doi.org/10.1002/9781444304992.ch9

14.

Bowman, N.A., Miller, A., Woosley, S., Maxwell, N.P., & Kolze, M.J. (2019). Understanding the link between noncognitive attributes and college retention. Research in Higher Education, 60, 135–152. https://doi.org/10.1007/s11162-018-9508-0

15.

Carneiro

Heckman

J. J.

Vytlacil

(2010). Evaluating marginal policy changes and the average effect of treatment for individuals at the margin. Econmetrica, 78(1), 337–394. https://doi.org/10.3982/ecta7089

16.

Century Foundation. (2013). Bridging the higher education divide: Strengthening community colleges and restoring the American Dream. https://s3-us-west-2.amazonaws.com/production.tcf.org/app/uploads/2013/05/23060015/20130523-Bridging_the_Higher_Education_Divide-REPORT-ONLY-9.pdf

17.

Chingos

M. M.

(2016). No more free lunch for education policymakers and researchers. Brookings. https://www.brookings.edu/research/no-more-free-lunch-for-education-policymakers-and-researchers/

18.

Chingos

M. M.

(2018). What matters most for college completion? Academic preparation is a key predictor of success. American Enterprise Institute. http://www.aei.org/publication/what-matters-most-for-college-completion-academic-preparation-is-a-key-predictor-of-success/

19.

Collier

D.A.

Fitzpatrick

Brehm

Archer

(2019). Coming to college hungry: How food insecurity relates to amotivation, stress, engagement, and first-semester performance in a 4-year university (No. 3490080). SSRN. https://papers.ssrn.com/sol3/papers.cfm?abstract_id = 3490080

20.

Collier

D. A.

Mishra

Houston

D. A.

Hensley

B. O.

Hartlep

N. D.

(2019). Americans ‘support’ the idea of tuition-free college: An exploration of sentiment and political identity signals otherwise. Journal of Further and Higher Education, 43(3), 347–362. https://doi.org/10.1080/0309877X.2017.1361516

21.

Collier

D. A.

Parnther

(2018). Conversing with Kalamazoo Promise scholars: An inquiry into the beliefs, motivations, and experiences of tuition-free students. Journal of College Student Retention: Research, Theory, & Practice. Advance online publication. https://doi.org/10.1177/1521025118774561

22.

Collier

D. A.

Parnther

Fitzpatrick

Brehm

Beach

(2019). Helping students keep the Promise: Exploring how Kalamazoo Promise scholars’ basic needs, motivation, and engagement correlate to performance and persistence in a 4-year institution. Innovative Higher Education, 44, 333–350. https://doi.org/10.1007/s10755-019-9468-0

23.

Crosnoe

Muller

(2014). Family socioeconomic status, peers, and the path to college. Social Problems, 61(4), 602–624, https://doi.org/10.1525/sp2014.12255

24.

DesJardins

S. L.

Toutkoushian

R. K.

(2005). Are students really rational? The development of rational thought and its application to student choice. In John C. Smart (ed.), Higher education: Handbook of theory and research (pp. 191–240). Springer. https://doi.org/10.1007/1-4020-3279-x_4

25.

Domina

Brummett

Pharris-Ciurej

Porter

S. R.

Penner

Sanabria

(2017). Capturing more than poverty: School free and reduced-price lunch data and household income (No. 2017-09)[Working paper]. Center for Administrative Records Research and Application. https://www.census.gov/content/dam/Census/library/working-papers/2017/adrm/carra-wp-2017-09.pdf

26.

Domina

Pharris-Ciurej

Penner

A. M.

Penner

E. K.

Brummet

Porter

S. R.

Sanabria

(2018). Is free and reduced-price lunch a valid measure of educational disadvantage? Educational Researcher (Online), ▪, 1–17. https://doi.org/10.3102/0013189X18797609

27.

Eberts

(2014). Longer-term effects of the Kalamazoo Promise: College enrollment, persistence and completion. Paper presented at the meeting of PromiseNet, New Haven, CT. http://citeseerx.ist.psu.edu/viewdoc/download?doi = 10.1.1.666.7709&rep = rep1&type = pdf

28.

Erb-Downward

Evangelist

(2018). A snapshot of homelessness and housing instability in Michigan schools. University of Michigan. https://poverty.umich.edu/files/2018/02/brief-student-homelessness.pdf

29.

Goldrick-Rab

(2016). Paying the price: College costs, financial aid, and the betrayal of the American Dream. The University of Chicago Press. https://doi.org/10.7208/chicago/9780226404486.001.0001

30.

Goldrick-Rab

Miller-Adams

(2018). Don’t dismiss the value of free-college programs. They do help low income students. The Chronicle of Higher Education. https://www.chronicle.com/article/Don-t-Dismiss-the-Value-of/244468

31.

Harwell

LeBeau

(2010). Student eligibility for a free lunch as an SES measure in education research. Educational Researcher, 39(2), 120–131. https://doi.org/10.3102/0013189X10362578

32.

Hershbein

B. J.

(2013). A second look at enrollment changes after the Kalamazoo Promise (No. 13-200). W.E. Upjohn Institute. http://research.W.E. Upjohn.org/cgi/viewcontent.cgi?article = 1217&context = up_workingpapers

33.

Hershbein

B.J.

(2015). The Kalamazoo Promise: A beginning, not an end. Brookings. https://www.brookings.edu/blog/social-mobility-memos/2015/06/25/the-kalamazoo-promise-a-beginning-not-an-end/

34.

Hoxby

Avery

(2012). The missing “one-offs”: The hidden supply of high-achieving, low-income students (No. 18586). National Bureau of Economic Research. https://doi.org/10.3386/w18586

35.

Imbens

G. W.

(2004). Nonparametric estimation of average treatment effects under exogeneity: A review. Review of Economics and Statistics, 86, 4–29.

36.

Jones

Berger

(2018). A promise fulfilled. The Education Trust. https://edtrust.org/resource/a-promise-fulfilled/

37.

Kalamazoo Public Schools. (2018, May 29). P.A. 25 annual education report & NCLB report card. https://www.kalamazoopublicschools.com/Portals/0/KPS%20Site%20Docs/Annual%20Report%202017/District_Final.pdf?ver = 2018-06-01-044028-530

38.

Larose

D. T.

Larose

C. D.

(2014). Imputation of missing data. In Discovering knowledge in data (2nd ed., pp. 266–276). John Wiley & Sons, Inc. https://doi.org/10.1002/9781118874059.ch13

39.

Liu

(2016). Goodbye to summer vacation? The effects of summer enrollment on college and employment outcomes. Columbia University. https://ccrc.tc.columbia.edu/media/k2/attachments/goodbye-to-summer-vacation-the-effects-of-summer-enrollment-on-college-and-employment-outcomes.pdf

40.

Mazur

(2016). Homes on the range: Homeownership rates are higher in rural America. Census Blogs, U.S. Census Bureau. https://www.census.gov/newsroom/blogs/random-samplings/2016/12/homes_on_the_range.html

41.

McMahon

(2009). Higher learning, greater good: The private and social benefits of higher education. Johns Hopkins Press.

42.

Miller-Adams

(2015). Promise nation: Transforming communities through place-based scholarship. W.E. Upjohn Institute. http://research.Upjohn.org/cgi/viewcontent.cgi?article = 1253&context = up_press

43.

Miron

Jones

J. N.

Kelaher-Young

A. J.

(2011). The Kalamazoo Promise and perceived changes in school climate. Education Policy Analysis Archives, 19(17), 2–25. https://doi.org/10.14507/epaa.v19n17.2011

44.

MI School Data. (2018a). Free and reduced lunch counts. https://www.mischooldata.org/Other2/DataFiles/StudentCounts/HistoricalFreeAndReducedLunchCounts.aspx

45.

MI School Data. (2018b). Student counts. https://www.mischooldata.org/DistrictSchoolProfiles2/StudentInformation/StudentCounts/StudentCount.aspx

46.

Nicholson

L. M.

Slater

S. J.

Chriqui

J. F.

Chaloupka

(2014). Validating adolescent socioeconomic status: Comparing school free or reduced-price lunch with community measures. Spatial Demography, 2(1), 55–65. https://doi.org/10.1007/BF03354904

47.

Perna

L. W.

(2006). Studying college access and choice: A proposed conceptual model. In Smart

J. C.

(Ed.), Higher Education: Handbook of Theory and Research (pp. 99–157).00 Springer.

48.

Perna

L. W.

Leigh

E. W.

(2018). Understanding the promise: A typology of state and local college promise programs. Educational Researcher, 47(3), 155–180. https://doi.org/10.3102/0013189X17742653

49.

Pirracchio

Carnone

Rigon

M. R.

Caruna

Mebazaa

Chevret

(2016). Propensity score estimators for the average treatment effect and the average treatment effect on the treated may yield very different estimates. Statistical Methods in Medical Research, 25(5), 1938–1954. https://doi.org/10.1177/0962280213507034

50.

Poutre

Voight

(2018). The state of free college: Tennessee Promise and New York’s Excelsior Scholarship. Institute for Higher Education Policy. http://www.ihep.org/research/publications/state-free-college-tennessee-promise-and-new-yorks-excelsior-scholarship

51.

Sackett

P. R.

Kuncel

N. R

., Beatty, A. S., Rigdon, J. L., Shen, W. Kieger

T.B.

(2012). The role of socioeconomic status in SAT-grade relationships in college and admissions decisions. Psychological Science, 23(9), 1000–1007. https://doi.org/10.1177/0956797612438732

52.

Shadish

W. R.

Clark

M. H.

Steiner

P. M.

(2008). Can nonrandomized experiments yield accurate answers? A randomized experiment comparing random and nonrandom assignments. Journal of the American Statistical Association, 103(484), 1334–1344. https://doi.org/10.1198/016214508000000733

53.

Smerillo

N. E.

Reynolds

A. J.

Temple

J. A.

S. R.

(2018). Chronic absence, eighth-grade achievement, and high school attainment in the Chicago Longitudinal Study. Journal of School Psychology, 67, 163–178. https://doi.org/10.1016/j.jsp.2017.11.001

54.

Sohn

Rubenstein

Murchie

Bifulco

(2017). Assessing the effects of placed based scholarship on urban revitalization: The case of say yes to education. Educational Evaluation and Policy Analysis, 39(2), 198–222. https://doi.org/10.3102/0162373716675727

55.

StataCorp Release 14. (2015). Stata treatment-effects reference manual: Potential outcomes/counterfactual outcomes. Stata Press Publication.

56.

Svrluga

(2018, July 24). Debt-free college? House Democrats introduce higher education bill. The Washington Post. https://www.washingtonpost.com/local/education/debt-free-college-house-democrats-introduce-higher-education-bill/2018/07/23/4930eec4-8ecd-11e8-8322-b5482bf5e0f5_story.html?noredirect = on&utm_term = .e5d4f3833e92

57.

Tan

(2010). Bounded, efficient and doubly robust estimation with inverse weighting. Biometrika, 97(3), 661–682. https://doi.org/10.1093/biomet/asq035

58.

U.S. Census Bureau. (n.d.). 2010 census urban and rural classification and urban area criteria. https://www.census.gov/geo/reference/ua/urban-rural-2010.html

59.

U.S. Department of Education National Center for Education Statistics. (2018). Common core of data. https://nces.ed.gov/ccd/

60.

U.S. Department of Education National Center for Education Statistics. (2019). Look up an institution: Western Michigan University. https://nces.ed.gov/ipeds/datacenter/InstitutionProfile.aspx?unitId = acb2adb1b4b4

61.

U.S. Internal Revenue Service. (n.d.) SOI tax stats – Individual income tax return (Form 1040) statistics. https://www.irs.gov/statistics/soi-tax-stats-individual-income-tax-return-form-1040-statistics

62.

Walker

Zhu

(2018). University selectivity and the relative returns to higher education: Evidence from the UK. Labour Economics, 53, 230–249. https://doi.org/10.1016/j.labeco.2018.05.005

63.

Western Michigan University. (n.d.). Tuition and fees. https://wmich.edu/admissions/freshmen/cost-scholarships/tuition

64.

W.E. Upjohn Institute. (2018a). Kalamazoo Promise: Data collection. https://W.E.Upjohn.org/kalamazoo-promise-data-collection

65.

W.E. Upjohn Institute. (2018b). Promise database. https://upjohn.org/promise/database/promiseSearch.html#scrollSpot