Developmental education has been cited as one of the most difficult issues facing community colleges. Despite the controversy and changes to educational policy regarding developmental education, there is a notable dearth of rigorous research measuring the causal effect of remediation on community college student outcomes. The present study uses data from the Beginning Postsecondary Students Longitudinal Study (BPS: 04/09) to measure the impact of developmental education on community college students’ odds of persistence and vertical transfer after controlling for enrollment in remediation and institutional-level variables. Propensity score matching results reveal that students who enroll in developmental courses are systematically different from community college students who do not remediate in gender, ethnicity, first-generation status, academic preparation and experiences during high school, and delayed college entry. Moreover, post-matching hierarchical generalized linear modeling (HGLM) findings demonstrate that developmental education may overall serve to decrease community college students’ odds of successfully transferring to a 4-year institution, with negative impacts on students enrolled in English and mathematics courses. Implications for research, policy, and practice are addressed.
AndersonG. M.AlfonsoM.SunJ. C. (2006). Rethinking cooling out at public community colleges: An examination of fiscal and demographic trends in higher education and the rise of statewide articulation agreements. Teachers College Record, 108, 422-451.
2.
AttewellP.LavinD.DominaT.LeveyT. (2006). New evidence on college remediation. Journal of Higher Education, 77, 886-924.
3.
BahrP. R. (2007). Double jeopardy: Testing the effects of multiple basic skill deficiencies on successful remediation. Research in Higher Education, 48, 695-725.
4.
BahrP. R. (2008). Does mathematics remediation work? A comparative analysis of academic attainment among community college students. Research in Higher Education, 49, 420-450.
5.
BahrP. R. (2010). Revising the efficacy of postsecondary remediation: The moderating effects of depth/breadth of deficiency. The Review of Higher Education, 33, 177-205.
6.
BaileyT. (2009). Challenge and opportunity: Rethinking the role and function of developmental education in community college. New Directions for Community Colleges, 145, 11-30.
7.
BaileyT.ChoS. W. (October, 2010). Developmental education in community colleges. Issue Briefprepared for the White House Summit on Community Colleges, Teachers College, Community College Research Center, Columbia University, New York, NY.
8.
BaileyT.JenkinsD.LeinbachT. (2005). Community college low-income and minority student completion study: Descriptive statistics from the 1992 high school cohort. New York, NY: Columbia University, Teachers College, Community College Research Center.
9.
BaileyT.JeongD. W.ChoS.-W. (2010). Referral, enrollment, and completion in developmental education sequences in community colleges. Economics of Education Review, 29, 255-270.
10.
BettingerE. P.LongB. T. (2005). Remediation at the community college: Student participation and outcomes. New Directions for Community Colleges, 129, 17-26.
11.
BurleyH. (1997, July). From policy to learning: The effectiveness of developmental education in Texas community colleges (Final report). Lubbock: Texas Tech University.
12.
CalcagnoJ. C. (2007). Evaluating the impact of developmental education in community colleges: A quasi-experimental regression-discontinuity design (PhD dissertation). Columbia University, Graduate School of Arts and Sciences, New York, NY.
13.
CalcagnoJ. C.CrostaP.BaileyT.JenkinsD. (2007, September). Does age of entrance affect community college completion probabilities? Evidence from a discrete-time hazard model. Educational Evaluation and Policy Analysis, 29, 218-235.
14.
CalcagnoJ. C.LongB. T. (2008). The impact of postsecondary remediation using a regression discontinuity approach: Addressing endogenous sorting and noncompliance (NBER Working Paper 14194). Cambridge, MA: National Bureau of Economic Research.
15.
CaliendoM.KopeinigS. (2008). Some practical guidance for the implementation of propensity score matching. Journal of Economic Surveys, 22, 31-72. doi:10.1111/j.1467-6419.2007.00527.x
16.
ChenX. (2005). First-generation students in postsecondary education: A look at their college transcripts (NCES 2005–171). Washington, DC: U.S. Government Printing Office, U.S. Department of Education, National Center for Education Statistics.
17.
CrewsD. M.AragonS. R. (2007). Developmental education writing: Persistence and goal attainment among community college students. Community College Journal of Research and Practice, 31, 637-652.
18.
CrispG.NoraA. (2010). Hispanic student success: Factors influencing the persistence and transfer decisions of Latino community college students enrolled in developmental education. Research in Higher Education, 51, 175-194. doi:10.1007/s11162-009-9151-x
19.
CrispG.NúñezA. M. (in press). Understanding the racial transfer gap: Modeling underrepresented minority and nonminority students’ pathways from two-to four-year institutions. The Review of Higher Education.
20.
Dana Center, Complete College America, Education Commission of the States, & Jobs for the Future. (2012). Core principles for transforming remedial education: A joint statement. Retrieved from http://www.completecollege.org/docs/CCA_joint_report-printer.pdf
21.
DoughertyK. J.KienzlG. S. (2006). It’s not enough to get through the open door: Inequalities by social background in transfer from community colleges to four-year colleges. Teachers College Record, 108, 452-487.
22.
EasterlingD. N.PattenJ. E.KrileD. J. (1998, May19). Patterns of progress: Student persistence isn’t always where you expect it. Paper presented at the annual meeting of the Association for Institutional Research, Minneapolis, MN.
23.
EddyP. L.ChristieR.RaoM. (2006). Factors affecting transfer of “traditional” community college students. The Community College Enterprise, 12(1), 73-92.
24.
EndersC. K. (2008, March). Analysis of missing data. Paper presented at the annual meeting of the American Educational Research Association, New York, NY.
25.
FikeD. S.FikeR. (2008). Predictors of first-year student retention in the community college. Community College Review, 36, 68-88.
26.
GrahamS. E.KurlaenderM. (2011). Using propensity scores in educational research: General principles and practical applications. The Journal of Educational Research, 104, 340-353.
27.
GrimesS. K.DavidK. C. (1999). Underprepared community college students: Implications of attitudinal and experiential differences. Community College Review, 27, 73-92.
28.
GrubbW. N. (2001, February). From black box to Pandora’s box: Evaluating remedial/developmental education (CCRC Brief No. 11). New York, NY: Columbia University, Teachers College, Community College Research Center.
29.
GuoS.FraserM. W. (2010). Propensity score analysis: Statistical methods and analysis. Thousand Oaks, CA: SAGE.
30.
HagedornL. S.SiadatM. V.FogelS. F.NoraA.PascarellaE. T. (1999). Success in college mathematics: Comparisons between remedial and non-remedial first-year college students. Research in Higher Education, 40, 261-284.
31.
HughesK. L.Scott-ClaytonJ. (2011, February). Assessing developmental assessment in community colleges (CCRC Working Paper No. 19, Assessment of Evidence Series). New York, NY: Community College Research Center, Teachers College, Columbia University. Retrieved from http://ccrc.tc.columbia.edu/Publication.asp?UID=856
32.
JenkinsD.JaggarsS. S.RoksaJ. (2009, November). Promoting gatekeeper course success among community college students needing remediation. New York, NY: Community College Research Center.
33.
JepsenC. (2006, April). Basic skills in California’s community colleges: Evidence from staff and self referrals. Paper presented at the meeting of the American Education Research Association (AERA), San Francisco, CA.
34.
KolajoE. F. (2004). From developmental education to graduation: A community college experience. Community College Journal of Research and Practice, 28, 365-371.
35.
LavinD.AlbaR.SilbersteinR. (1981). Right versus privilege: The open admissions experiment at City University of New York. New York, NY: Free Press.
36.
LeeV. E.FrankK. A. (1990). Students characteristics that facilitate the transfer from 2-year to 4-year colleges. Sociology of Education, 63, 178-193.
37.
LeuvenE.SianesiB. (2003). PSMATCH2: Stata module to perform full Mahalanobis and propensity score matching, common support graphing, and covariate imbalance testing (Version 11). Retrieved from http://ideas.repec.org/c/boc/bocode/s432001.html
38.
LevinH. M.CalcagnoJ. C. (2008). Remediation in the community college. Community College Review, 35, 181-207.
39.
MartorellP.McFarlinI. J. (2011). Help or hindrance? The effects of college remediation on academic and labor market outcomes. The Review of Economics and Statistics, 93(2), 436-454.
40.
McCormickA. C. (2003). Swirling and double-dipping: New patterns of student attendance and their implications for higher education. New Directions for Higher Education, 121, 13-24.
41.
MelguizoT.BosJ.PratherG. (2011). Is developmental education helping community college’ students persist? A critical review of the literature. American Behavioral Scientist, 55, 173-184.
42.
MerisotisJ.PhippsR. (2000). Remedial education in colleges and universities: What’s really going on?The Review of Higher Education, 24, 67-85.
43.
MossB. G.YeatonW. H. (2006). Shaping policies related to developmental education: An evaluation using the regression-discontinuity design. Educational Evaluation and Policy Analysis, 28, 215-230.
44.
NoraA. (2004). The role of habitus and cultural capital in choosing a college, transitioning from high school to higher education, and persisting in college among minority and non-minority students. Journal of Hispanic Higher Education, 3(2), 180-208.
45.
NoraA. (2009). Remediation of college students: A summary of empirical findings on developmental education. Austin: Texas Higher Education Coordinating Board.
46.
NuñezA.-M.Cuccaro-AlaminS. (1998). First-Generation students: Undergraduates whose parents never enrolled in postsecondary education (NCES 98–082). Washington, DC: U.S. Government Printing Office, U.S. Department of Education, National Center for Education Statistics.
47.
O’ConnorW.MorrisonT. (1997). Do remedial mathematics programmes improve students’ mathematical ability?Studies in Educational Evaluation, 23, 201-207.
48.
ParkerT. L. (2007). Ending college remediation: Consequences for access and opportunity (ASHE/Lumina Policy Briefs and Critical Essays, No. 2). Ames: Iowa State University, Department of Educational Leadership and Policy Studies.
49.
PengC. J.SoT. H.StageF. K.St. JohnE. P. (2002). The use and interpretation of logistic regression in higher education journals: 1988–1999. Research in Higher Education, 43, 259-293.
50.
PennyM. D.WhiteJ.WilliamG. (1998). Developmental mathematics students’ performance: Impact of faculty and student characteristics. Journal of Developmental Education, 22(2), 2-9.
51.
PorcheaS. F.AllenJ.RobbinsS.PhelpsR. P. (2010). Predictors of long-term enrollment and degree outcomes for community college students: Integrating academic, psychosocial, socio-demographic and situational factors. The Journal of Higher Education, 81, 750-778.
52.
RaudenbushS. W.BrykA. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: SAGE.
53.
RaudenbushS. W.YangM.YosefM. (2000). Maximum likelihood for generalized linear models with nested random effects via high-order, multivariate Laplace approximation. Journal of Computational and Graphical Statistics, 9, 141-157.
54.
RosenbaumP. R.RubinD. B. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70, 41-55.
55.
RosenbaumP. R.RubinD. B. (1984). Reducing bias in observational studies using sob-classification on the propensity score. Journal of the American Statistical Association, 79, 516-524.
56.
SaxonP. D.BoylanH. R. (2001). The cost of remedial education in higher education. Journal of Developmental Education, 25(2), 2-8.
57.
SchneiderB.CarnoyM.KilpatrickJ.SchmidtW. H.ShavelsonR. J. (2007). Estimating causal effects using experimental and observational designs: A think tank white paper. Washington, DC: American Educational Research Association.
58.
Scott-ClaytonJ.RodriquezO. (2012). Development, discouragement, or diversion? New evidence on the effects of college remediation (Working Paper 18328). National Bureau of Economic Research. Retrieved from http://www.nber.org/papers/w18328
59.
ShavelsonR. J.TowneL. (Eds.). (2002). Scientific research in education. Washington, DC: National Research Council, National Academy Press.
TitusM. A. (2007). Detecting selection bias using propensity score matching and estimating treatment effects: An application to the private returns to a Master’s degree. Research in Higher Education, 48, 487-521. doi:10.1007/s11162-006-9034-3
62.
WangX. (2012). Factors contributing to the upward transfer of baccalaureate aspirants beginning at community colleges. The Journal of Higher Education, 83, 851-875.
63.
WaycasterP. (2001). Factors impacting success in community college developmental mathematics courses and subsequent courses. Community College Journal of Research and Practice, 25, 406-416.
64.
WeissmanJ.SilkE.BulakowskiC. (1997). Assessing developmental education policies. Research in Higher Education, 38, 187-200.
