Applying Text Mining to Identify Critical Factors Contributing to the Retention Rate of First-Year Students at Historically Black Colleges and Universities

Abstract

Between 2007 and 2022, four-year Historically Black Colleges and Universities (HBCUs) consistently exhibited lower first-year student retention (FYSR) rates compared to four-year non-profit higher education institutions that are not HBCUs. The average difference over this 14-year period was approximately 14% between 2011 and 2022. The lower FYSR rates at HBCUs may indicate administrative challenges, potentially impacting their ability to provide educational services for Black students effectively. To accomplish this, we analyzed 11,993 students’ online comments from 2010 to 2022 across 53 four-year HBCUs with low FYSR rates. We utilized latent Dirichlet allocation to construct topics and n-grams to identify positive and negative word sequences from each constructed topic. Furthermore, we conducted a university-level regression analysis to examine the relationship between student satisfaction ratings on each topic and FYSR rates. Finally, we discuss strategies to improve the FYSR rates at these HBCUs.

Keywords

text mining student satisfaction HBCU first-year student retention

Get full access to this article

View all access options for this article.

References

Adamopoulos

(2013). What makes a great MOOC? An interdisciplinary analysis of student retention in online courses.

Barros

(2018). What is school spirit? Retrieved from https://www.theclassroom.com/school-spirit-5050088.html

Beltyukova

S. A.

Fox

C. M.

(2002). Student satisfaction as a measure of student development: Towards a universal metric. Journal of College Student Development, 43(2), 161–172.

Bengfort

Bilbro

Ojeda

(2018). Applied text analysis with Python: Enabling language-aware data products with machine learning. O'Reilly Media, Inc.

Blei

D. M.

A. Y.

Jordan

M. I.

(2003). Latent Dirichlet allocation. Journal of Machine Learning Research, 3(Jan), 993–1022.

Britt

S. L.

Ammerman

D. A.

Barrett

S. F.

Jones

(2017). Student loans, financial stress, and college student retention. Journal of Student Financial Aid, 47(1), 3. https://doi.org/10.55504/0884-9153.1605

Buckingham Shum

Knight

McNamara

Allen

Bektik

Crossley

(2016, April). Critical perspectives on writing analytics. In Proceedings of the sixth international conference on learning analytics & knowledge (pp. 481–483). https://doi.org/10.1145/2883851.2883854

Cardona

Cudney

E. A.

Hoerl

Snyder

(2023). Data mining and machine learning retention models in higher education. Journal of College Student Retention: Research, Theory & Practice, 25(1), 51–75. https://doi.org/10.1177/1521025120964920

Cavnar

W. B.

Trenkle

J. M.

(1994, April). N-gram-based text categorization. In Proceedings of SDAIR-94, 3rd annual symposium on document analysis and information retrieval (Vol. 161175, p. 14).

10.

Crawford

II (2017). HBCUs: Accreditation, governance and survival challenges in an ever-increasing competition for funding and students. Journal of Research Initiatives, 2(3), 1.

11.

Cuseo

(2007). The empirical case against large class size: Adverse effects on the teaching, learning, and retention of first-year students. The Journal of Faculty Development, 21(1), 5–21.

12.

Danbert

S. J.

Pivarnik

J. M.

McNeil

R. N.

Washington

I. J.

(2014). Academic success and retention: The role of recreational sports fitness facilities. Recreational Sports Journal, 38(1), 14–22. https://doi.org/10.1123/rsj.2013-0010

13.

(2011). Predicting student attrition with data mining methods. Journal of College Student Retention: Research, Theory & Practice, 13(1), 17–35. https://doi.org/10.2190/CS.13.1.b

14.

Douglas

McClelland

Davies

(2008). The development of a conceptual model of student satisfaction with their experience in higher education. Quality Assurance in Education, 16(1), 19–35. https://doi.org/10.1108/09684880810848396

15.

Dukhie

(2023). Sense of Belonging: Impact of HBCU Living Learning Communities on University Retention. Doctoral dissertation, Tennessee State University.

16.

Elliott

K. M.

Healy

M. A.

(2001). Key factors influencing student satisfaction related to recruitment and retention. Journal of Marketing for Higher Education, 10(4), 1–11. https://doi.org/10.1300/J050v10n04_01

17.

Ferreira-Mello

André

Pinheiro

Costa

Romero

(2019). Text mining in education. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 9(6), e1332. https://doi.org/10.1002/widm.1332

18.

Fike

D. S.

Fike

(2008). Predictors of first-year student retention in the community college. Community College Review, 36(2), 68–88. https://doi.org/10.1177/0091552108320222

19.

Forrester

S. A.

McAllister-Kenny

Locker

(2018). Association between collegiate recreational sports involvement and undergraduate student retention. Recreational Sports Journal, 42(1), 64–74. https://doi.org/10.1123/rsj.2017-0004

20.

Graham

(2023). September 8. Greek life on HBCU campuses. Bestcolleges. Retrieved June 15, 2024.

21.

Gregory

K. M.

(2011). How undergraduates perceive their professors: A corpus analysis of rate my professor. Journal of Educational Technology Systems, 40(2), 169–193. https://doi.org/10.2190/ET.40.2.g

22.

Henry

F. D.

(2021). Persistence and retention strategies implemented at HBCUs that support successful degree attainment of African American men.

23.

Hinton

S. L.

(2014). Factors that affect retention among freshman students at Historically Black Colleges and Universities. Argosy University/Phoenix.

24.

Hujala

Knutas

Hynninen

Arminen

(2020). Improving the quality of teaching by utilising written student feedback: A streamlined process. Computers & Education, 157, 103965. https://doi.org/10.1016/j.compedu.2020.103965

25.

Hutto

C. P.

Fenwick

L. T.

(2002). Staying in College: Student services and freshman retention at historically black colleges and universities (HBCUs).

26.

Jones

W. A.

(2010). Football and freshmen retention: Examining the impact of college football on institutional retention rates. Journal of College Student Retention: Research, Theory & Practice, 11(4), 551–564. https://doi.org/10.2190/CS.11.4.f

27.

Kadupitiya

J. C. S.

Ranathunga

Dias

(2016, September). Automated assessment of multi-step answers for mathematical word problems. In 2016 Sixteenth International Conference on Advances in ICT for Emerging Regions (ICTer) (pp. 66–71). IEEE.

28.

Kilgarriff

Grefenstette

(2011). Introduction to the special issue on the web as corpus. Computational Linguistics, 29(3), 333–347. https://doi.org/10.1162/089120103322711569

29.

King-Berry

Charles

C. E.

(2021). Faculty & student retention: Keeping our HBCU-UDC alive during the COVID-19 pandemic. Education and New Developments, 563–567. https://doi.org/10.36315/2021end119

30.

Kovanovic

Joksimovic

Gasevic

Hatala

Siemens

(2015). Content analytics: The definition, scope, and an overview of published research. Handbook of Learning Analyitc.

31.

Kuh

G. D.

Kinzie

Schuh

J. H.

Whitt

E. J.

(2011). Student success in college: Creating conditions that matter. John Wiley & Sons.

32.

Lewkow

Feild

Zimmerman

Riedesel

Essa

Boulanger

Seanosky

Kumar

Kinshuk Kode

(2016, April). A scalable learning analytics platform for automated writing feedback. In Proceedings of the third (2016) ACM conference on learning@ scale (pp. 109–112). https://doi.org/10.1145/2876034.2893380

33.

Johnson

Aarhus

Shah

(2022). Key factors in MOOC pedagogy based on NLP sentiment analysis of learner reviews: What makes a hit. Computers & Education, 176, 104354. https://doi.org/10.1016/j.compedu.2021.104354

34.

Litman

(2016). Natural language processing for enhancing teaching and learning. In Proceedings of the thirtieth AAAI conference on artificial intelligence (pp. 4170–4176). AAAI Press.

35.

Marsh

(2014). Institutional characteristics and student retention in public 4-year colleges and universities. Journal of College Student Retention: Research, Theory & Practice, 16(1), 127–151. https://doi.org/10.2190/CS.16.1.g

36.

Muollo

Basavaraj

Garibay

(2018, October). Understanding Students’ online reviews to improve college experience and graduation rates of STEM programs at the largest post-secondary institution: A learner-centered study. In 2018 IEEE Frontiers in Education Conference (FIE) (pp. 1–7). IEEE.

37.

Niche. (2024). Niche.com. https://www.niche.com/about/niche-guidelines-for-reporting-and-removing-content/

38.

O'Keeffe

(2013). A sense of belonging: Improving student retention. College Student Journal, 47(4), 605–613.

39.

Onan

(2021). Sentiment analysis on massive open online course evaluations: A text mining and deep learning approach. Computer Applications in Engineering Education, 29(3), 572–589. https://doi.org/10.1002/cae.22253

40.

Otto

Sanford

D. A.

Jr Ross

D. N.

(2008). Does ratemyprofessor. Com really rate my professor? Assessment & Evaluation in Higher Education, 33(4), 355–368. https://doi.org/10.1080/02602930701293405

41.

Pascarella

E. T.

Terenzini

P. T.

(2005). How College Affects Students: A Third Decade of Research (vol. 2). Jossey-Bass, An Imprint of Wiley. 10475 Crosspoint Blvd, Indianapolis, IN 46256.

42.

Pilkington

Bowen

Rose

R. C.

Rajasinghe

D. R.

Evans

(2018). A qualitative study of student retention: The university academic’s perspective. International Journal of Academic Multidisciplinary Research, 2(10), 19–28.

43.

Roberts

Styron

Jr (2010). Student satisfaction and persistence: Factors vital to student retention. Research in Higher Education Journal, 6(3), 1e18.

44.

Rudniy

Elliot

(2016, June). Collaborative Review in Writing Analytics: N-Gram Analysis of Instructor and Student Comments. EDM (Workshops).

45.

Santos

C. L.

Rita

Guerreiro

(2018). Improving international attractiveness of higher education institutions based on text mining and sentiment analysis. International Journal of Educational Management, 32(3), 431–447. https://doi.org/10.1108/IJEM-01-2017-0027

46.

Schertzer

C. B.

Schertzer

S. M.

(2004). Student satisfaction and retention: A conceptual model. Journal of Marketing for Higher Education, 14(1), 79–91. https://doi.org/10.1300/J050v14n01_05

47.

Schreiner

L. A.

(2009). Linking student satisfaction and retention. Noel-Levitz.

48.

Shomade

Adams

(2021). How to nurture virtually: The challenge of replicating the HBCU experience online. In The black experience and navigating higher education through a virtual world (pp. 163–183). IGI Global.

49.

Soika

(2020). What Is Student Retention, and Why Does It Matter? University of Southern California. Retrieved from https://rossier.usc.edu/news-insights/news/what-student-retention-and-why-does-it-matter

50.

Srinivas

Rajendran

(2019). Topic-based knowledge mining of online student reviews for strategic planning in universities. Computers & Industrial Engineering, 128, 974–984. https://doi.org/10.1016/j.cie.2018.06.034

51.

Thomas

E. H.

Galambos

(2004). What satisfies students? Mining student-opinion data with regression and decision tree analysis. Research in Higher Education, 45, 251–269. https://doi.org/10.1023/B:RIHE.0000019589.79439.6e

52.

Tinto

(2007). Taking student retention seriously. Syracuse University.

53.

Y. J.

Webber

K. L.

(2018). College student retention on a racially diverse campus: A theoretically guided reality check. Journal of College Student Retention: Research, Theory & Practice, 20(1), 2–28. https://doi.org/10.1177/1521025116643325

54.

Yang

Kinshuk An

(2023). A survey of the literature: How scholars use text mining in educational studies? Education and Information Technologies, 28(2), 2071–2090. https://doi.org/10.1007/s10639-022-11193-3

55.

Yeo

R. K.

(2009). Service quality ideals in a competitive tertiary environment. International Journal of Educational Research, 48(1), 62–76. https://doi.org/10.1016/j.ijer.2009.03.004