Measuring,Manipulating,and Predicting Student Success: A 10-Year Assessment of Carnegie R1 Doctoral Universities Between 2004 and 2013

Abstract

Student success measurements for 4-year institutions of higher education are a topic of importance for numerous stakeholders including prospective and current students, parents, staff, faculty, administrators, governing boards, policymakers, and citizens. Common measures of student success are retention rates and 4- and 6-year graduation rates. However, the standardization, accuracy, and reporting of these rates are less than scientific due in part to the operational definition provided by the federal government for reporting graduation rates. The current system for reporting retention and graduation rates are flawed. As accountability continues to increase for institutions of higher education, this analysis provides comparative, qualitative, and quantitative research with the goal of informing and assisting universities, as they strive to increase the rates at which their students succeed. A particular emphasis will be placed on an empirical analysis over a 10-year period of time for retention and graduation rates of 115 Carnegie R1 doctoral universities.

Get full access to this article

View all access options for this article.

References

Albright

(2010, July 9). Suggestions for improving the IPEDS graduation rate survey data collection and reporting (NPEC 2010-832). Retrieved from National Postsecondary Education Cooperative: http://nces.ed.gov/pubs2010/2010832.pdf

Alexander

(2000). The changing face of accountability: Monitoring and assessing institutional performance in higher education. The Journal of Higher Education, 71(4), 411–431. doi:10.2307/2649146

Anderson

Rucker

(2013, August 22). Obama proposes college-rating system in bid to Increase affordability. The Washington Post. Retrieved from https://www.washingtonpost.com/politics/obama-to-propose-college-ranking-system-that-could-increase-affordability/2013/08/22/73e674c0-0b17-11e3-b87c-476db8ac34cd_story.html

Astin

A. W.

(1971). Predicting academic performance in college: Selectivity data for 2300 American colleges. New York, NY: The Free Press.

Astin

A. W.

(1977). Four critical years: Effects of college on beliefs, attitudes, and knowledge. San Francisco, CA: Jossey-Bass.

Astin

A. W.

(1991). Assessment for excellence: The philosophy and practice of assessment and evaluation in higher education. New York, NY: American Council on Education and Macmillan Publishing Company.

Astin

(1993, September 22) College retention rates are often misleading. Chronicle of Higher Education, 22, A48. Retrieved from http://www.chronicle.com/article/College-Retention-Rates-Are/92037/

Astin

A. W.

(1997). How “good” is your institution’s retention rate? Research in Higher Education, 38(6), 647–658. doi:10.1023/A:1024903702810

Astin

A. W.

(2005). Making sense out of degree completion rates. Journal of College Student Retention: Research, Theory & Practice, 7(1-2), 5–17. doi:10.2190/7PV9-KHR7-C2F6-UPK5

10.

Bean

J. P.

(1980). Dropouts and turnover: The synthesis and test of a causal model of student attrition. Research in Higher Education, 12(2), 155–187. doi:10.1007/BF00976194

11.

Bean

J. P.

(1985). Interaction effects based on class level in an explanatory model of college student dropout syndrome. American Educational Research Journal, 22(1), 35–64. doi:10.3102/00028312022001035

12.

Bean

J. P.

(1990). Using retention research in enrollment management. In Hossler

(Ed.), The strategic management of college enrollments (pp. 170–185). San Francisco, CA: Jossey-Bass.

13.

Berger

J. B.

Lyon

S. C.

(2005). Past to present: A historical look at retention. In Seidman

(Ed.), College student retention: Formula for student success (pp. 1–30). Westport, CT: American Council on Education.

14.

Berkner

Cataldi

E. F.

(2002, December 16). Descriptive summary of 1995-96 beginning postsecondary students: Six years later. Statistical analysis report. Retrieved from http://nces.ed.gov/pubs2003/2003151.pdf

15.

Brown

(2016, February 1). How a freshman-retention plan turned into a PR disaster for one campus. The Chronicle of Higher Education. Retrieved from http://chronicle.com/article/How-a-Freshman-Retention-Plan/235122/?key=ckJbRBItQjq5Bn-dcp_pmyb23Pu9LKLaUibREXJDwj5hRkJUY1I5WkhOeVE5ZGYyWGZLY0l1SlpRQVlNNXdEZUtpQm80X3BmQkpZ

16.

Bult

(2016, January 20). Maryland’s Mount St. Mary’s President allegedly likened struggling students to ‘bunnies’ you have to ‘drown,’ faculty say. Daily News. Retrieved from http://www.nydailynews.com/news/national/college-president-drown-failing-students-article-1.2503194

17.

Cabrera

A. F.

Nora

Castaneda

M. B.

(1993). College persistence: Structural equations modeling test of an integrated model of student retention. Journal of Higher Education, 64, 123–139. doi:10.2307/2960026

18.

Cardona

(2013, May 19). Texas colleges making gradual improvement in 4-year graduation rates. The Dallas Morning News. Retrieved from http://www.dallasnews.com/news/politics/headlines/20130519-texas-colleges-making-gradual-improvement-in-four-year-graduation-rates.ece

19.

Carey

(2004, May 1). A matter of degrees: Improving graduation rates at four-year colleges and universities. Retrieved from https://edtrust.org/resource/a-matter-of-degrees/

20.

Carnegie Classification of Institutions of Higher Education. (2016). Basic classification description. Retrieved from http://carnegieclassifications.iu.edu/classification_descriptions/basic.php

21.

Cook

Hartle

T. W.

(2011). Why graduation rates matter–and why they don’t. American Council on Education. Retrieved from http://www.acenet.edu/the-presidency/columns-and-features/Pages/Why-Graduation-Rates-Matter%E2%80%94and-Why-They-Don%E2%80%99t.aspx

22.

Croissant

Millo

(2008). Panel data econometrics in R: The plm package. Journal of Statistical Software, 27(2), 1–43. Retrieved from http://www.jstatsoft.org/v27/i02/

23.

Crow

M. M.

Dabars

W. B.

(2015). Designing the new American university. Baltimore, MD: JHU Press.

24.

Dey

E. L.

Astin

A. W.

(1993). Statistical alternatives for studying college student retention: A comparative analysis of logit, probit, and linear regression. Research in Higher Education, 34(5), 569–581. doi:10.1007/BF00991920

25.

Durkheim

(1951). Suicide (J. A. Spaulding & G. Simpson, Trans.). Glencoe, IL: Free Press. (Original work published 1897)

26.

Enders

De Boer

Weyer

(2013). Regulatory autonomy and performance: The reform of higher education re-visited. Higher Education, 65(1), 5–23. doi:10.1007/s10734-012-9578-4

27.

Eykamp

P. W.

(1995). Political control of state research universities: The effect of the structure of political control on university quality and budget (Unpublished doctoral dissertation). University of California, San Diego.

28.

Glenn

(2010, December 6). 6-Year graduation rates: A 6-minute primer. The Chronicle of Higher Education. Retrieved from http://www.chronicle.com/blogs/measuring/6-year-graduation-rates-a-6-minute-primer/27573

29.

Goenner

C. F.

Snaith

S. M.

(2004a). Predicting graduation rates: An analysis of student and institutional factors at doctoral universities. Journal of College Student Retention: Research, Theory & Practice, 5(4), 409–420. doi:10.2190/LKJX-CL3H-1AJ5-WVPE

30.

Goenner

C. F.

Snaith

S. M.

(2004b). Accounting for model uncertainty in the prediction of university graduation rates. Research in Higher Education, 45(1), 25–41. doi:10.1023/B:RIHE.0000010045.13366.a6

31.

Hagedorn

L. S.

(2005). How to define retention: A new look at an old problem. In Seidman

(Ed.), College student retention: Formula for success (pp. 89–105). Westport, CT: American Council on Education.

32.

Knott

J. H.

Payne

A. A.

(2004). The impact of state governance structures on management and performance of public organizations: A study of higher education institutions. Journal of Policy Analysis and Management, 23(1), 13–30. doi:10.1002/pam.10176

33.

Kroc

Howard

Hull

Woodard

(1997). Graduation rates: Do students’ academic program choices make a difference? (PDF document). Retrieved from http://files.eric.ed.gov/fulltext/ED417677.pdf

34.

Kroc, R. D., Howard, R. H., & Hull, P. (1995). Predicting graduation rates: A study of land grant, research I, and AAU universities. Paper presented at the Association for Institutional Research meeting, Boston, 1995.

35.

Kutner

(2014, August 26). How to game the college rankings. Boston Magazine. Retrieved from http://www.bostonmagazine.com/news/article/2014/08/26/how-northeastern-gamed-the-college-rankings/3/

36.

Machung

(1998). Playing the ranking game. Change: The Magazine of Higher Learning, 30(4), 12–16. doi:10.1080/00091389809602626

37.

McNeely

J. H.

(1938). College student mortality (U.S. Office of Education, Bulletin 1937, no. 11). Washington, DC: U.S. Government Printing Office.

38.

Morse

Brooks

Mason

(2015, September 9). How U.S. news calculated the 2016 best colleges rankings. Retrieved from U.S. News and World Report: http://www.usnews.com/education/best-colleges/articles/how-us-news-calculated-the-rankings

39.

Murtaugh

P. A.

Burns

L. D.

Schuster

(1999). Predicting the retention of university students. Research in Higher Education, 40(3), 355–371. doi:10.1023/A:1018755201899

40.

O’Dwyer

L. M.

Parker

C. E.

(2014, December 23). A primer for analyzing nested data: Multilevel modeling in SPSS using an example from a REL study (REL 2015-046). Retrieved from Regional Educational Laboratory Northeast & Islands: http://ies.ed.gov/ncee/edlabs/regions/northeast/pdf/REL_2015046.pdf

41.

O’Meara

(2007). Striving for what? Exploring the pursuit of prestige. In Higher education: Handbook of theory and research. In J.C. Smart (ed) (pp. 121–179). Dordrecht, the Netherlands: Springer.

42.

Pascarella

E. T.

Terenzini

P. T.

(1980). Predicting freshman persistence and voluntary dropout decisions from a theoretical model. The Journal of Higher Education, 51(1), 60–75. doi:10.2307/1981125

43.

Pascarella

E. T.

Terenzini

P. T.

(1991). How college affects students ( Vol. 1). San Francisco, CA: Jossey-Bass.

44.

Perez-Pena

Slotnik

D. E.

(2012, February 1). Gaming the college rankings. The New York Times, p. 31. Retrieved from http://www.nytimes.com/2012/02/01/education/gaming-the-college-rankings.html?_r=0

45.

Porter

S. R.

(2000). The robustness of the graduation rate performance indicator used in the U.S. News & World Report college rankings. International Journal of Educational Advancement, 1(2), 145–163.

46.

Pusser

(2004). Knowledge and money: Research universities and the paradox of the marketplace (book). Academe, 90(6), 115–116.

47.

Selingo

J. J.

(2013). College (un) bound: The future of higher education and what it means for students. Las Vegas, NV: Amazon Publishing.

48.

Shin

J. C.

Toutkoushian

R. K.

(2011). The past, present, and future of university rankings. In University rankings (pp. 1–16). Dordrecht, the Netherlands: Springer. doi:10.1007/978-94-007-1116-7_1

49.

Spady

W. G.

(1970). Dropouts from higher education: An interdisciplinary review and synthesis. Interchange, 1(1), 64–85. doi:10.1007/BF02214313

50.

Student Right-To-Know and Campus Security Act of 1990, Pub L. No, 101-542, 102-26. Retrieved from https://www.congress.gov/bill/101st-congress/senate-bill/580

51.

Svrluga

(2016, February 29). Mount St. Mary’s university president resigns. The Washington Post. Retrieved from https://www.washingtonpost.com/news/grade-point/wp/2016/02/29/mount-st-marys-future-direction-on-the-table-as-leaders-meet-today/?utm_term=.a7123dbc4a05

52.

The University of Texas at Dallas. (2016, March 24). 2014 fifth-year interim report, Provost’s Technology Group. Retrieved from https://web.archive.org/web/20150405030852/http://sacscoc.utdallas.edu/5yrnav/

53.

Tinto

(1975). Dropout from higher education: A theoretical synthesis of recent research. Review of Educational Research, 45(1), 89–125. doi:10.3102/00346543045001089

54.

Tinto

(1987). Leaving college: Rethinking the causes and cures of student attrition. Chicago, IL: University of Chicago Press.

55.

Tinto

(1999). Taking retention seriously: Rethinking the first year of college. NACADA Journal, 19(2), 5–9. doi:10.12930/0271-9517-19.2.5

56.

Tinto

(2002, June 20). Establishing conditions for student success: Lessons learned in the United States. Speech presented at 11th Annual Conference of European Access Network, Prato, Italy. Retrieved from https://vtinto.expressions.syr.edu/wp-content/uploads/2013/01/European-Access-Network-2002-Keynote.pdf

57.

Tinto

(2006). Research and practice of student retention: What next? Journal of College Student Retention: Research, Theory & Practice, 8(1), 1–19. doi:10.2190/4YNU-4TMB-22DJ-AN4W

58.

U.S. Department of Education. (2015, May). Digest of education statistics, 2013 (NCES 2015–011). Retrieved from National Center for Education Statistics: https://nces.ed.gov/programs/digest/d13/ch_2.asp

59.

U.S. Department of Education. (2016a, August 24). IPEDS 2018–2019 data collection system. Retrieved from Institute of Education Sciences, National Center for Education Statistics: https://surveys.nces.ed.gov/ipeds/Downloads/Forms/IPEDSGlossary.pdf

60.

U.S. Department of Education. (2016b, September 13). College scorecard data. Retrieved from https://collegescorecard.ed.gov/data/

61.

Watkins

(2016, April 9). How UT-Dallas transformed itself into a top Texas college. The Texas Tribune. Retrieved from https://www.texastribune.org/2016/04/09/how-ut-dallas-has-climbed-ranks-texas-top-colleges/

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.16 MB