How Can Placement Policy Improve Math Remediation Outcomes? Evidence From Experimentation in Community Colleges

Abstract

Changing placement policy may help to improve developmental education student outcomes in community colleges, but there is little understanding of the impacts of these reforms. We take advantage of heterogeneous placement policy in a large urban community college district in California to compare the effects of math remediation under different policy contexts. District colleges either switched from using math diagnostics to using computer-adaptive tests, or raised placement cutoffs. We use quasi-experimental methods to identify the impact of remediation under each policy and the change in impact following placement policy experimentation. We find that switching to a computer-adaptive test exacerbated the penalty of remediation for marginal students and resulted in more placement errors. Modestly raising placement cutoffs had no significant effects.

Keywords

community colleges remedial/developmental education placement tests regression discontinuity

Get full access to this article

View all access options for this article.

References

Armstrong

W. B.

(2000). The association among student success in courses, placement test scores, student background data, and instructor grading practices. Community College Journal of Research and Practice, 24, 681–695.

Asera

(2011). Innovation at scale: How Virginia community colleges are collaborating to improve developmental education and increase student success. Boston, MA: Jobs for the Future.

Bailey

Jeong

D. W.

Cho

S. W.

(2010). Referral, enrollment, and completion in developmental education sequences in community colleges. Economics of Education Review, 29, 255–270.

Betts

J. R.

Hahn

Zau

A. C.

(2011). Does diagnostic math testing improve student learning? San Francisco: Public Policy Institute of California. Retrieved from http://www.ppic.org/content/pubs/report/R_1011JBR.pdf

Burdman

(2012). Where to begin? The evolving role of placement exams for students starting college. Boston, MA: Jobs for the Future.

Burdman

(2015). Degrees of freedom: Probing math placement policies at California colleges and universities (No. 3). Stanford: Policy Analysis for California Education.

Cameron

A. C.

Gelbach

J. B.

Miller

D. L.

(2011). Robust inference with multiway clustering. Journal of Business & Economic Statistics, 29(2), 238–249.

Clark

(1960). The open door college. New York, NY: McGraw-Hill.

Cohen

A. M.

Brawer

F. B.

(2003). The American community college. San Francisco, CA: John Wiley.

10.

Deil-Amen

Tevis

T. L.

(2010). Circumscribed agency: The relevance of standardized college entrance exams for low SES high school students. The Review of Higher Education, 33, 141–175.

11.

Fain

(2015, June 18). Finding a new compass. Inside Higher Ed. Retrieved from https://www.insidehighered.com/news/2015/06/18/act-drops-popular-compass-placement-test-acknowledging-its-predictive-limits

12.

Fields

Parsad

(2012). Tests and cut scores used for student placement in postsecondary education: Fall 2011. Washington, DC: National Assessment Governing Board.

13.

Fong

Melguizo

Prather

(2015). Increasing success rates in developmental math: The complementary role of individual and institutional characteristics. Research in Higher Education. Advance online publication. doi:10.1007/s11162-015-9368-9

14.

Foundation for California Community Colleges. (2015). California community colleges. Retrieved from https://www.foundationccc.org/Portals/0/Documents/NewsRoom/FactSheets/ccc-facts-figures.pdf

15.

Fulton

(2012). Using state policies to ensure effective assessment and placement in remedial education. Denver, CO: Education Commission of the States.

16.

Hodara

Jaggars

S. S.

Karp

M. M.

(2012). Improving developmental education assessment and placement: Lessons from community colleges across the country (CCRC Working Paper No. 51). New York, NY: Community College Research Center, Columbia University.

17.

Huang

C.-W.

Snipes

Finkelstein

(2014). Using assessment data to guide math course placement of California middle school students (REL 2014–040). Washington, DC: U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, Regional Educational Laboratory West. Retrieved from http://ies.ed.gov/ncee/edlabs

18.

Hughes

K. L.

Scott-Clayton

(2011). Assessing developmental assessment in community colleges. Community College Review, 39, 327–351.

19.

Imbens

Kalyanaraman

(2012). Optimal bandwidth choice for the regression discontinuity estimator. Review of Economic Studies, 79, 933–959.

20.

Jaggars

S. S.

Hodara

(2013). The opposing forces that shape developmental education. Community College Journal of Research and Practice, 37, 575–579.

21.

Jenkins

Jaggars

S. S.

Roksa

(2009). Promoting gatekeeper course success among community college students needing remediation: Findings and recommendations from a Virginia Study. New York, NY: Community College Research Center. Retrieved from http://eric.ed.gov/?id=ED507824

22.

Lee

D. S.

Lemieux

(2010). Regression discontinuity designs in economics. Journal of Economic Literature, 48, 281–355.

23.

Martorell

McFarlin

Jr. (2011). Help or hindrance? The effects of college remediation on academic and labor market outcomes. The Review of Economics and Statistics, 93, 436–454.

24.

Martorell

McFarlin

Jr. Xue

(2015). Does failing a placement exam discourage underprepared students from enrolling college? Education Finance and Policy, 10, 46–80.

25.

Marwick

J. D.

(2004). Charting a path to success: The association between institutional placement policies and the academic success of Latino students. Community College Journal of Research and Practice, 28, 263–280.

26.

Mattern

K. D.

Packman

(2009). Predictive validity of ACCUPLACER scores for course placement: A meta-analysis (Research Report No. 2009-2). New York, NY: College Board.

27.

Medhanie

A. G.

Dupuis

D. N.

LeBeau

Harwell

M. R.

Post

T. R.

(2012). The role of the ACCUPLACER mathematics placement test on a student’s first college mathematics course. Educational and Psychological Measurement, 72, 332–351.

28.

Melguizo

(2011). A review of the theories developed to describe the process of college persistence and attainment. In Smart

J. C.

Paulsen

M. B.

(Eds.) Higher education: Handbook of theory and research (pp. 395–424). Dordrecht, The Netherlands: Springer.

29.

Melguizo

Bos

Ngo

Mills

Prather

(in press). Using a regression discontinuity design to estimate the impact of placement decisions in developmental math. Research in Higher Education.

30.

Melguizo

Hagedorn

L. S.

Cypers

(2008). Remedial/developmental education and the cost of community college transfer: A Los Angeles County sample. The Review of Higher Education, 31, 401–431.

31.

Melguizo

Kosiewicz

Prather

Bos

(2014). How are community college students assessed and placed in developmental math? Grounding our understanding in reality. Journal of Higher Education, 85, 691–722.

32.

Murnane

R. J.

Willett

J. B.

(2010). Methods matter: Improving causal inference in educational and social science research. Oxford, UK: Oxford University Press.

33.

National Center for Public Policy and Higher Education & Southern Regional Education Board. (2010). Beyond the rhetoric: Improving college readiness through coherent state policy. Atlanta, GA: National Center for Public Policy and Higher Education. Retrieved from http://publications.sreb.org/2010/Beyond%20the%20Rhetoric.pdf

34.

Ngo

Kwon

(2015). Using multiple measures to make math placement decisions: Implications for access and success in community colleges. Research in Higher Education, 56, 442–470.

35.

Papay

J. P.

Murnane

R. J.

Willett

J. B.

(2011). How performance information affects human-capital investment decisions: The impact of test-score labels on educational outcomes (No. w17120). Cambridge, MA: National Bureau of Economic Research.

36.

Perry

Bahr

P. M.

Rosin

Woodward

K. M.

(2010). Course-taking patterns, policies, and practices in developmental education in the California Community Colleges. Mountain View, CA: EdSource.

37.

Reardon

S. F.

Robinson

J. P.

(2012). Regression discontinuity designs with multiple rating-score variables. Journal of Research on Educational Effectiveness, 5, 83–104.

38.

Robinson

J. P.

(2011). Evaluating criteria for English learner reclassification: A causal-effects approach using a binding-score regression discontinuity design with instrumental variables. Educational Evaluation and Policy Analysis, 33, 267–292.

39.

Rodríguez

(2014). Increasing access to college-level math: Early outcomes using the Virginia Placement Test. Retrieved from http://ccrc.tc.columbia.edu/publications/increasing-access-to-college-level-math.html

40.

Rodríguez

Bowden

Belfield

Scott-Clayton

(2014, September). Remedial placement testing in community colleges: What resources are required, and what does it cost? (CCRC Working Paper No. 73). New York, NY: Community College Research Center.

41.

Scott-Clayton

Crosta

Belfield

(2014). Improving the targeting of treatment: Evidence from college remediation. Educational Evaluation and Policy Analysis, 36, 371–393.

42.

Scott-Clayton

Rodriguez

(2015). Development, discouragement, or diversion? New evidence on the effects of college remediation. Education Finance and Policy, 10, 4–45.

43.

Stigler

J. W.

Givvin

K. B.

Thompson

B. J.

(2010). What community college developmental mathematics students understand about mathematics. MathAMATYC Educator, 1(3), 4–16.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.37 MB