Competency Based Education Pilot in Illinois: Preliminary Findings

Abstract

In this study we employed regression analysis and between-group matched pair design to analyze whether participation in a competency-based education pilot was associated with improved high school completion and postsecondary entry. Data were obtained for high schools participating in a CBE pilot program in Illinois. Results of the matched pair design showed that CBE participation was significantly associated with higher rates of high school graduation for seniors across all groups with differences significant overall (97.2% for CBE vs. 93.1% for non-CBE), for White students (97.2% vs. 92.7%), and for students eligible for Free and Reduced Lunch (96.3% vs. 90.3%). Graduation rate for seniors was also higher for African American students and for Hispanic-Latinx students, but the differences were not statistically significant. In the matched pair design, CBE participation was not significantly associated with entry into college within 12 months of high school.

Keywords

education policy competency-based education mastery-based education proficiency-based education propensity score matching program evaluation

Get full access to this article

View all access options for this article.

References

Allensworth

E. M.

Clark

(2020). High school GPAs and ACT scores as predictors of college completion: Examining assumptions about consistency across high schools. Educational Researcher, 49(3), 198–211.

Attewell

. (2001). The winner-take-all high school: Organizational adaptations to educational stratification. Sociology of Education, 267–295.

Aurora Institute. (2019). iNACOL releases updates to the snapshot of K-12 competency education state policy across the United States. https://aurora-institute.org/blog/inacol-releases-updates-to-the-snapshot-of-k-12-competency-education-state-policy-across-the-united-states/

Austin

P. C.

(2011). An introduction to propensity score methods for reducing the effects of confounding in observational studies. Multivariate Behavioral Research, 46, 399–424.

Bill & Melinda Gates Foundation, Afton Partners, Eli & Edythe Broad Foundation, CEE Trust, Christensen Institute, Charter School Growth Fund, Silicon Schools. (2014). A working definition of personalized learning. https://assets.documentcloud.org/documents/1311874/personalized-learning-working-definitionfall2014.pdf

Blankenberger

. (2020). Higher education policy environment and accountability. In Slagle

Williams

(Eds.), Practicum in Public Administration (pp. 11–43). Birkdale Publishers.

Blankenberger

Gehlhausen Anderson

Lichtenberger

. (2021). Improving institutional evaluation methods: Comparing evaluations using PSM, Exact and Coarsened Exact Matching. Research in Higher Education, 62(8), 1248–1275.

Blankenberger

Lichtenberger

Witt

M. A

. (2017a). Dual credit participation, college selectivity, and enhanced degree attainment. Educational Researcher 46(5), 259–263.

Blankenberger

Lichtenberger

Witt

M. A.

Franklin

. (2017b). Diverse students, high school factors, and completion agenda goals: An analysis of the Illinois class of 2003. Education and Urban Society 49(5), 518–545.

10.

Bloom

B. S.

(1968). Learning for mastery. Instruction and curriculum. Regional education laboratory for the Carolinas and Virginia, topical papers and reprints, number 1. Evaluation comment, 1(2), n2.

11.

Bowen

W. G.

Chingos

M. M.

McPherson

M. S.

(2009). Crossing the finish line: Completing college at America’s public universities. Princeton University Press.

12.

Cabral

M. D.

Luiz

R. R.

(2007). Sensitivity analysis for unmeasured confounders using an electronic spreadsheet. Revista de Saúde Pública, 41, 446–452.

13.

Chen

M. Y.

Liu

Zumbo

B. D.

(2020). A propensity score method for investigating differential item functioning in performance assessment. Educational and Psychological Measurement, 80(3), 476–498.

14.

Chen

(2012). Institutional characteristics and college student dropout risks: A multilevel event history analysis. Research in Higher Education, 53, 487–505.

15.

Chen

DesJardins

S. L.

(2010). Investigating the impact of financial aid on student dropout risks: Racial and ethnic differences. The Journal of Higher Education, 81(2), 179–208.

16.

Deye

(2017). Overview of K-12 competency-based education. National Council of State Legislatures. https://www.ncsl.org/research/education/overview-of-k-12-competency-based-education.aspx

17.

Deye

(2018). A look at competency-based education in K-12 schools. National Council of State Legislatures. https://www.ncsl.org/research/education/a-look-at-competency-based-education-in-k-12-schools.aspx#:~:text=The%20NCSL%20Student%2DCentered%20Learning,and%20student%2Downed%20learning%20environments

18.

Dumais

S. A.

(2002). Cultural capital, gender, and school success: The role of habitus. Sociology of Education, 75(1), 44–68.

19.

Espenshade

T. J.

Hale

L. E.

Chung

C. Y.

(2005). The frog pond revisited: High school academic context, class rank, and elite college admission. Sociology of Education, 78, 269–293.

20.

Evans

C. M.

Graham

S. E.

Lefebvre

M. L.

(2019). Exploring K-12 competency-based education implementation in the Northeast States. NASSP Bulletin, 103(4), 300–329.

21.

Evans

C. M.

Landl

Thompson

(2020). Making sense of K-12 competency-based education: A systematic literature review of implementation and outcomes research from 2000 to 2019. The Journal of Competency-Based Education, 5(4), e01228.

22.

Field

Feinberg

(2019, April 19). Inside Maine’s disastrous rollout of proficiency-based learning. The Hechinger Report. https://hechingerreport.org/inside-maines-disastrous-roll-out-of-proficiency-based-learning/

23.

Geiser

Santelices

M. V.

(2007). Validity of high-school grades in predicting student success beyond the freshman year: High-school record vs. standardized tests as indicators of four-year college outcomes. Center for Studies in Higher Education.

24.

Gehlhausen Anderson

Blankenberger

. (2023). Validation and living learning communities: An evaluation case study. Journal of College Student Retention: Research, Theory & Practice, 25(1), 76–100

25.

Gravezetter

F. J.

Forzano

L. B.

(2009). Research methods for the behavioral sciences (3rd ed.). Wadsworth.

26.

Guskey

T. R.

Gates

S. L.

(1986). Synthesis of research on the effects of mastery learning in elementary and secondary classrooms. Educational Leadership: Journal of the Department of Supervision and Curriculum Development, N.E.A, 43(8), 73–80.

27.

Harris

Horst

S. J.

(2016). A brief guide to decisions at each step of the propensity score matching process. Practical Assessment, Research, and Evaluation, 21(1), 4. https://doi.org/10.7275/yq7r-4820

28.

Illinois General Assembly. (2016). Postsecondary and Workforce Readiness Act, 110 ILCS 148.

29.

Illinois State Board of Education. (2021). PWR act overview. https://www.isbe.net/pwr

30.

Illinois State Board of Education. (2022). Illinois report card, 2020-21. https://www.isbe.net/Pages/ReportCardArchive.aspx

31.

Illinois State Board of Education. (2023). Competency pilot. https://www.isbe.net/competency

32.

Kim

D. H.

Pieper

C. F.

Ahmed

Colón-Emeric

C. S.

(2016). Use and interpretation of propensity scores in aging research: A guide for clinical researchers. Journal of the American Geriatrics Society, 64(10), 2065–2073.

33.

King

Nielsen

(2019). Why propensity scores should not be used for matching. Political Analysis, 27(4), 435–454.

34.

LaSota

R. R.

Zumeta

(2016). What matters in increasing community college students’ upward transfer to the baccalaureate degree: Findings from the beginning postsecondary study 2003–2009. Research in Higher Education, 57, 152–189.

35.

Wolfe

R. E.

Steinberg

(2014). The past and the promise: Today’s competency education movement. Students at the center: Competency education research series. Jobs for the Future.

36.

Lewis

M. W.

Eden

Garber

Rudnick

Santibanez

Tsai

(2014). Equity in competency education: Realizing the potential, overcoming the obstacles. Jobs for the Future.

37.

Lichtenberger

George-Jackson

(2012). Predicting high school students’ interest in majoring in a STEM field: Insight into high school students’ postsecondary plans. Journal of Career and Technical Education, 28(1), 19–38.

38.

Lichtenberger

Witt

M. A.

Blankenberger

Franklin

. (2014). Dual credit/dual enrollment and data driven policy implementation. Journal of Community College Research and Practice, 38(11), 959–979.

39.

Lopez

Patrick

Sturgis

(2017). Quality and equity by design: Charting the course for the next phase of competency-based education. Competency Works and iNACOL.

40.

Miller

(2018, June 27). Legislators vote to ease Maine’s proficiency-based education mandate, allow more ‘local control’. Portland Press Herald. https://www.pressherald.com/2018/06/27/lawmakers-vote-to-eliminate-proficiency-based-education-mandate-in-maine/

41.

Mitchell

D. E.

Spady

W. G.

(1978). Organizational contexts for implementing outcome based education. Educational Researcher, 7(7), 9–17.

42.

Pane

J. F.

Steiner

E. D.

Baird

M. D.

Hamilton

L. S.

Pane

J. D.

(2017). Informing progress: Insights on personalized learning implementation and effects. RAND Corporation.

43.

Perna

L. W.

Thomas

S. L.

(2006). A framework for reducing the college success gap and promoting success for all. National Symposium on Postsecondary Student Success.

44.

Reif

Shultz

Ellis

(2015). A qualitative study of student-centered learning practices in New England high schools. Nellie Mae Education Foundation.

45.

Rosenbaum

P. R

. (2002). Sensitivity to hidden Bias. In: Observational Studies. Springer Series in Statistics. Springer, New York, NY. https://doi.org/10.1007/978-1-4757-3692-2_4

46.

Rosenbaum

P. R.

(2007). Sensitivity analysis for m-estimates, tests and confidence intervals in matched observational studies. Biometrics, 63, 456–464.

47.

Rosenbaum

P. R.

Rubin

D. B.

(1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70(1), 41–55.

48.

Rossi

P. H.

Lipsey

M. W.

Freeman

H. E.

(2003). Evaluation: A systematic approach. Sage.

49.

Scheopner Torres

Brett

Cox

. (2015). Competency-based learning: Definitions, policies, and implementation. Education Development Center Inc.

50.

Spady

W. G.

(1977). Competency based education: A bandwagon in search of a definition. Educational Researcher, 6(1), 9–14. https://doi.org/10.3102/0013189x006001009

51.

Spady

W. G.

Mitchell

D. E.

(1977). Competency based education: Organizational issues and implications. Educational Researcher, 6(2), 9–15. https://doi.org/10.3102/0013189X006002009

52.

Stuart

E. A

. (2010). Matching methods for causal inference: A review and a look forward. Statistical Science, 25(1), 1–21.

53.

Sylvia

R. D.

Sylvia

K. M.

(2012). Program planning and evaluation for the public manager (4th ed.). Waveland Press, Inc.

54.

Thoemmes

(2012). Propensity score matching in SPSS. http://arxiv.org/ftp/arxiv/papers/1201/1201.6385.pdf

55.

Thoemmes

F. J.

Kim

E. S.

(2011). A systematic review of propensity score methods in the social sciences. Multivariate Behavioral Research, 46, 90–118.