A Comparison of Academic Outcomes in Courses Taught With Open Educational Resources and Publisher Content

Abstract

What difference do open educational resources (OER) make compared with publisher content (non-OER) when costs and instructors remain constant? A total of 215 community college students enrolled in online, introductory courses were randomly assigned to OER or non-OER sections and compared on retention at the tuition drop date, completion with a C or better, course completion, and mean final exam scores. Students in the OER sections were retained and persisted at a statistically significant higher rate, lending credibility to the findings of former studies regarding retention and persistence rates in courses taught with OER materials. No statistically significant differences were found on completion rates or final exam scores. OER course materials should be considered in broader initiatives for student success in community colleges.

Keywords

community colleges dropouts economics of education experimental design instructional practices retention student development

Get full access to this article

View all access options for this article.

References

Allen

Guzman–Alvarez

Molinaro

Larsen

(2015, January 27). Assessing the impact and efficacy of the open-access ChemWiki textbook project (Educause Learning Initiative Brief). https://library.educause.edu/-/media/files/library/2015/1/elib1501-pdf.pdf

Aragon

S. R.

Johnson

E. S.

(2008). Factors influencing completion and noncompletion of community college online courses. American Journal of Distance Education, 22(3), 146–158. https://doi.org/10.1080/08923640802239962

Arkes

H. R.

Blumer

(1985). The psychology of sunk cost. Organizational Behavior and Human Decision Processes, 35(1), 124–140. https://doi.org/10.1016/0749-5978(85)90049-4

Atkins

D. E.

Brown

J. S.

Hammond

A. L.

(2007). A review of the open educational resources (OER) movement: Achievements, challenges and new opportunities. William and Flora Hewlett Foundation. https://www.hewlett.org/wp-content/uploads/2016/08/ReviewoftheOERMovement.pdf

Bailey

Jenkins

Leinbach

(2005). What we know about community college low-income and minority student outcomes: Descriptive statistics from national surveys. Community College Research Center. http://ccrc.tc.columbia.edu/publications/low-income-minority-student-outcomes.html

Belikov

Bodily

(2016). Incentives and barriers to OER adoption: A qualitative analysis of faculty perceptions. Open Praxis, 8(3), 235–246. https://doi.org/10.5944/openpraxis.8.3.308

Beneito

Boscá

J. E.

Ferri

(2018). Tuition fees and student effort at university. Economics of Education Review, 64, 114–128.

Caswell

Henson

Jensen

Wiley

(2008). Open educational resources: Enabling universal education. International Review of Research in Open and Distributed Learning, 9(1). https://doi.org/10.19173/irrodl.v9i1.469. http://www.irrodl.org/index.php/irrodl/article/view/469/1001

Chan

H. Y.

Wang

(2017). Momentum through course completion patterns among 2-year college students beginning in STEM: Variations and contributing factors. Research in Higher Education, 59(6), 704–743. https://doi.org/10.1007/s11162-017-9485-8

10.

Chiorescu

(2017). Exploring open educational resources for college algebra. International Review of Research in Open and Distributed Learning, 18(4). https://doi.org/10.19173/irrodl.v18i4.3003. http://www.irrodl.org/index.php/irrodl/article/view/3003/4223

11.

Feldstein

Martin

Hudson

Warren

Hilton

Wiley

(2012). Open textbooks and increased student access and outcomes. European Journal of Open, Distance and E–Learning. https://files.eric.ed.gov/fulltext/EJ992490.pdf

12.

Florida Virtual Campus. (2016, October 7). 2016 Student textbook and course materials survey: Results and findings. Office of Distance Learning & Student Services. https://www.flvc.org/documents/96858/931951/2016+Student+Textbook+Survey.pdf/591cf5b0-bbe8-406d-acd8-b23d89b8577f

13.

Grewe

K. E.

Davis

P. W.

(2017). The impact of enrollment in an OER course on student learning outcomes. International Review of Research in Open and Distributed Learning, 18(4). https://doi.org/10.19173/irrodl.v18i4.2986. http://www.irrodl.org/index.php/irrodl/article/view/2986/4211

14.

Hagedorn

L. S.

(2006). How to define retention: A new look at an old problem. The Transfer and Retention of Urban Community College Students Project. http://files.eric.ed.gov/fulltext/ED493674.pdf

15.

Hidalgo

Onofa

Oosterbeek

Ponce

(2013). Can provision of free school uniforms harm attendance? Evidence from Ecuador. Journal of Development Economics, 103, 43–51. https://doi.org/10.1016/j.jdeveco.2012.12.006

16.

Hilton

III . (2016). Open educational resources and college textbook choices: A review of research on efficacy and perceptions. Education Technology Research and Development, 64, 573–590. https://doi.org/10.1007/s11423-016-9434-9

17.

Hilton

III Laman

(2012). One college’s use of an open psychology textbook. Open Learning: The Journal of Open, Distance and e-Learning, 27(3), 265–272. https://doi.org/10.1080/02680513.2012.716657

18.

Hilton

J. L.

III Fischer

Wiley

Williams

(2016). Maintaining momentum toward graduation: OER and the course throughput rate. International Review of Research in Open and Distributed Learning, 17(6), 19–27.

19.

Hilton

J. L.

III Gaudet

Clark

Robinson

Wiley

(2013). The adoption of open educational resources by one community college math department. International Review of Research in Open and Distance Learning, 14(4), 37–50. https://doi.org/10.19173/irrodl.v14i4.1523

20.

Hilton

J. L.

III Robinson

Wiley

Ackerman

(2014). Cost-savings achieved in two semesters through the adoption of open educational resources. International Review of Research in Open and Distributed Learning, 15(2), 67–84. https://doi.org/10.19173/irrodl.v15i2.1700

21.

Jhangiani

R. S.

Pitt

Hendricks

Key

Lalonde

(2016, January 18). Exploring faculty use of open educational resources at British Columbia post-secondary institutions (Research report). BCcampus. https://eduq.info/xmlui/bitstream/handle/11515/35344/exploring-faculty-use-of-oer-british-columbia-post-secondary-institutions-bccampus-2016.pdf?sequence=2

22.

Jung

Sasaki

T. S.

Latchem

C. C.

(2016). A framework for assessing fitness for purpose in open educational resources. International Journal of Educational Technology in Higher Education, 13(1), 1–11. https://doi.org/10.1186/s41239-016-0002-5

23.

Ketel

Linde

Oosterbeek

Van Der Klaauw

(2016). Tuition fees and sunk-cost effects. The Economic Journal, 126(598), 2342–2362. https://doi.org/10.1111/ecoj.12297

24.

Levitt

S. D.

List

J. A.

Neckermann

Sadoff

(2016). The behavioralist goes to school: Leveraging behavioral economics to improve educational performance. American Economic Journal: Economic Policy, 8(4), 183–219. https://doi.org/10.1257/pol.20130358

25.

Lovett

Meyer

Thille

(2008). JIME–The Open Learning Initiative: Measuring the effectiveness of the OLI statistics course in accelerating student learning. Journal of Interactive Media in Education, 2008(1). https://doi.org/10.5334/2008-14

26.

Pender

Libassi

C. J.

(2020), Trends in college pricing and student aid 2020. College Board.

27.

McGill

(2013). What are open educational resources? Jisc. https://openeducationalresources.pbworks.com/w/page-revisions/24836860/What%20are%20Open%20Educational%20Resources

28.

Nakajma

M. A.

Dembo

M. H.

Mossler

(2012). Student persistence in community colleges. Community College Journal of Research and Practice, 36(8), 591–613. https://doi.org/10.1080/10668920903054931

29.

National Center for Education Statistics. (2017). Search for schools and colleges. https://nces.ed.gov/globallocator/

30.

Pawlyshyn

Braddlee

Casper

Miller

(2013, November 4). Adopting OER: A case study of cross-institutional collaboration and innovation. Educause Review. https://er.educause.edu/articles/2013/11/adopting-oer-a-case-study-of-crossinstitutional-collaboration-and-innovation

31.

Pell Institute. (2018). Indicators of higher education equity in the United States: 2018 Historical trend report. Pell Institute for the Study of Opportunity in Higher Education; PENNAhead Alliance of Higher Education and Democracy. http://pellinstitute.org/indicators/reports_2018.shtml

32.

Phelan

D. J.

(2016). Unrelenting change, innovation, and risk: Forging the next generation of community colleges. Rowman & Littlefield.

33.

Raisman

(2013). The cost of college attrition at four-year colleges and universities (Policy Perspectives). Education Policy Institute. https://vtechworks.lib.vt.edu/bitstream/handle/10919/83250/CostCollegeAttrition.pdf?sequence=1&isAllowed=y

34.

Senack

(2014, January). Fixing the broken textbook market: How students respond to higher textbook costs and demand alternatives. U.S. PIRG Education Fund; Student PIRGs. http://www.uspirg.org/sites/pirg/files/reports/NATIONAL%20Fixing%20Broken%20Textbooks%20Report1.pdf

35.

Senack

Donoghue

(2016, February). Covering the cost: Why we can no longer afford to ignore high textbook prices. Student PIRGs. https://uspirg.org/sites/pirg/files/reports/National%20%20COVERING%20THE%20COST.pdf

36.

Student PIRGs. (2012, April 16). Federal Textbook Price Disclosure Law. http://www.studentpirgs.org/resources/textbook-price-disclosure-law

37.

United Nations Educational, Scientific, and Cultural Organization. (2002, July 1–3). Final report [Conference proceedings]. Forum on the Impact of Open Courseware for Higher Education in Developing Countries, Paris, France. http://unesdoc.unesco.org/images/0012/001285/128515e.pdf

38.

U.S. Bureau of Labor Statistics. (2016, August 30). College tuition and fees increase 63% since January 2006. TED: The Economics Daily. https://www.bls.gov/opub/ted/2016/college-tuition-and-fees-increase-63-percent-since-january-2006.htm

39.

Wiley

Williams

DeMarte

Hilton

(2016). The Tidewater Z-degree and the INTRO model for sustaining OER adoption. Education Policy Analysis Archives, 23(41), 1–12. https://doi.org/10.14507/epaa.24.1828

40.

Winitzky-Stephens

Pickavance

(2017). Open educational resources and student course outcomes: A multilevel analysis. International Review of Research in Open and Distributed Learning, 18(4), 35–49. https://doi.org/10.19173/irrodl.v18i4.3118

41.

Wood

J. L.

Harris

(2015). The effect of college selection factors on persistence: An examination of Black and Latino males in the community colleges. Journal of College Student Retention: Research, Theory & Practice, 16(4), 511–535. https://doi.org/10.2190/CS.16.4.c

42.

Jaggars

S. S.

(2011). The effectiveness of distance education across Virginia’s community colleges: Evidence from introductory college-level math and English courses. Educational Evaluation and Policy Analysis, 33(3), 360–377. https://doi.org/10.3102/0162373711413814