Do First-Year Seminars Improve College Grades and Retention? A Quantitative Review of Their Overall Effectiveness and an Examination of Moderators of Effectiveness

Abstract

We review the effectiveness of first-year seminars based on the widely used criteria of first-year grades and the 1-year retention rate. Meta-analytic results indicate that first-year seminars have a small average effect on both first-year grades (k = 89, N = 52,406, δ = 0.02) and the 1-year retention rate (k = 195, N = 169,666, δ = 0.11). We discuss the implications of these small effects and show that they are meaningful and have important consequences. Results also indicate that the effectiveness of first-year seminars for both criteria is substantially moderated by first-year seminar characteristics (e.g., type of seminar), institutional characteristics (e.g., 2-year or 4-year institution), and study characteristics (e.g., study design). We use these results to make recommendations about the design of first-year seminars that can maximize the positive effect on both the grades and retention of participants.

Keywords

first-year seminar orientation program meta-analysis effectiveness retention GPA academic performance

Get full access to this article

View all access options for this article.

References

ACT. (2014). 2014 Retention/completion summary tables. Retrieved from http://www.act.org/research/policymakers/pdf/14retain_trends.pdf

Alliger

G. M.

Tannenbaum

S. I.

Bennett

Traver

Shotland

(1997). A meta-analysis of the relations among training criteria. Personnel Psychology, 50, 341–358. doi:10.1111/j.1744-6570.1997.tb00911.x

Arthur

Bennett

Edens

P. S.

Bell

S. T.

(2003). Effectiveness of training in organizations: A meta-analysis of design and evaluation features. Journal of Applied Psychology, 88, 234–245. doi:10.1037/0021-9010.88.2.234

Astin

A. W.

(1993). What matters most in college: Four critical years revisited. San Francisco, CA: Jossey-Bass.

Austin

J. T.

Vancouver

J. B.

(1996). Goal constructs in psychology: Structure, process, and content. Psychological Bulletin, 120, 338–375. doi:10.1037/0033-2909.120.3.338

Babbitt

(2007). The impact of one-hour freshman seminars on student success at a research university (Doctoral dissertation). Available from ProQuest Dissertations and Theses database. (UMI No. 3268530)

Baker

R. W.

Siryk

(1984). Measuring adjustment to college. Journal of Counseling Psychology, 31, 179–189. doi:10.1037/0022-0167.31.2.179

Barefoot

B. O.

(1992). Helping first-year college students climb the academic ladder: Report of a national survey of freshman seminar programming in American higher education (Doctoral dissertation). Available from ProQuest Dissertations and Theses database. (UMI No. 9226630)

Barritt

L. S.

(1966). Note: The consistency of first-semester college grade point average. Journal of Educational Measurement, 3, 261–262.

10.

Bauer

T. N.

Erdogan

(2011). Organizational socialization: The effective onboarding of new employees. In Zedeck

(Ed.), APA handbook of industrial and organizational psychology (Vol. 3, pp. 51–64). Washington, DC: American Psychological Association.

11.

Bean

J. P.

(1980). Dropouts and turnover: The synthesis and test of a casual model of student attrition. Research in Higher Education, 12, 155–187. doi:10.1007/BF00976194

12.

Bean

J. P.

Metzner

B. S.

(1985). A conceptual model of nontraditional undergraduate student attrition. Review of Educational Research, 55, 485–540. doi:10.3102/00346543055004485

13.

Bell

B. J.

Holmes

M. R.

Williams

B. G.

(2010). A census of outdoor orientation programs at four-year colleges in the United States. Journal of Experiential Education, 33, 1–18. doi:10.5193/JEE33.1.1

14.

Bendig

A. W.

(1953). The reliability of letter grades. Educational and Psychological Measurement, 13, 311–321. doi:10.1177/001316445301300215

15.

Blackett

K. B.

(2008). The effects of a first-year success course on student retention and academic achievement at national American university (Doctoral dissertation). Available from ProQuest Dissertations and Theses database. (UMI No. 3318814)

16.

Bridgeman

McCamley-Jenkins

Ervin

(2000). Predictions of freshman grade point average from the revised and recentered SAT I: Reasoning Test (College Board Report No. 2000-1). Retrieved from http://research.collegeboard.org/sites/default/files/publications/2012/7/researchreport-2000-1-predictions-freshman-gpa-revised-recentered-sat-reasoning.pdf

17.

Britton

B. K.

Tesser

(1991). Effects of time-management practices on college grades. Journal of Educational Psychology, 83, 405–410. doi:10.1037/0022-0663.83.3.405

18.

Cabrera

A. F.

Nora

Castañeda

M. B.

(1993). College persistence: Structural modeling of an integrated model of student retention. Journal of Higher Education, 64, 123–139. doi:10.2307/2960026

19.

Campbell

J. P.

(1990). Modeling the performance prediction problem in industrial and organizational psychology. In Dunnette

M. D.

Hough

L. M.

(Eds.), Handbook of industrial and organizational psychology (pp. 687–732). Palo Alto, CA: Consulting Psychologists Press.

20.

Campbell

J. P.

McCloy

R. A.

Oppler

S. H.

Sager

C. E.

(1993). A theory of performance. In Schmitt

Borman

W. C.

(Eds.), Personnel selection in organizations (pp. 35–70). San Francisco, CA: Jossey-Bass.

21.

Chickering

A. W.

(1969). Education and identity. San Francisco, CA: Josey-Bass.

22.

Cohen

(1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.

23.

Cohen

Willis

T. A.

(1985). Stress, social support, and the buffering hypothesis. Psychological Bulletin, 98, 310–357. doi:10.1037/0033-2909.98.2.310

24.

Cole

(2008). How long should a training program be? A field study of “rules of thumb.” Journal of Workplace Learning, 20, 54–70. doi:10.1108/13665620810843647

25.

Credé

Kuncel

N. R.

(2008). Study habits, skills, and attitudes: The third pillar supporting collegiate academic performance. Perspectives on Psychological Science, 3, 425–453. doi:10.1111/j.1745-6924.2008.00089.x

26.

Credé

Niehorster

(2012). Adjustment to college as measured by the Student Adaptation to College Questionnaire: A quantitative review of its structure and relationships with correlates and consequences. Educational Psychology Review, 24, 133–165. doi:10.1007/s10648-011-9184-5

27.

Credé

Phillips

L. A.

(2011). A meta-analytic review of the Motivated Strategies for Learning Questionnaire. Learning and Individual Differences, 21, 337–346. doi:10.1016/j.lindif.2011.03.002

28.

Credé

Roch

Kieszczynka

U. M.

(2010). Class attendance in college: A meta-analytic review of the relationship of class attendance with grades and student characteristics. Review of Educational Research, 80, 272–295. doi:10.3102/0034654310362998

29.

Cuseo

J. B.

(n.d.). Fiscal benefits of student retention and first-year retention initiatives. Retrieved from http://www.ohio.edu/fye/upload/retention-fiscal-benefits.pdf

30.

Day

J. C.

Newburger

E. C.

(2002). The big payoff: Educational attainment and synthetic estimates of work-life earnings (Current Population Report No. P23-210). Retrieved from http://www.census.gov/prod/2002pubs/p23-210.pdf

31.

DeRoma

V. M.

Bell

N. L.

Zaremba

B. A.

Albee

J. C.

(2005). Evaluation of a college transition program for students at-risk for academic failure. Research and Teaching in Developmental Education, 21, 20–34.

32.

Duncan

T. G.

McKeachie

W. C.

(2005). The making of the Motivated Strategies for Learning Questionnaire. Educational Psychologist, 40, 117–128. doi:10.1207/s15326985ep4002_6

33.

Erikson

E. H.

(1959). Identity and the life cycle. New York, NY: International Universities Press.

34.

Fan

Buckley

M. R.

Litchfield

R. C.

(2012). Orientation programs that may facilitate newcomer adjustment: A literature review and future research agenda. In Martocchio

J. J.

Joshi

Liao

(Eds.), Research in personnel and human resources management (Vol. 31, pp. 87–143). Bingley, England: Emerald.

35.

Fan

Wanous

J. P

. (2008). Organizational and cultural entry: A new type of orientation program for multiple boundary crossings. Journal of Applied Psychology, 93, 1390–1400. doi:10.1037/a0012828

36.

Fitts

C. T.

Swift

F. H.

(1928). The construction of orientation courses for college freshmen. University of California Publications in Education, 1897–1929, 2, 145–250.

37.

Fry

M. K.

(2006). The relationship of admission type and freshman seminar participation to retention and academic success (Doctoral dissertation). Available from ProQuest Dissertations and Theses database. (UMI No. 3241822)

38.

Gabelnick

Macgregor

Matthew

R. S.

Smith

B. L.

(1990). Learning communities: Creating connections among students, faculty, and disciplines. San Francisco, CA: Jossey-Bass.

39.

Galloway

S. P.

(2000). Assessment in wilderness orientation programs: Efforts to improve college student retention. Journal of Experiential Education, 23, 75–84. doi:10.1177/105382590002300205

40.

Gaskins

B. P.

(2009). A ten-year study of the conditional effects on student success in the first year of college (Doctoral dissertation). Available from ProQuest Dissertations and Theses database. (UMI No. 3371000)

41.

Goldstein

I. L.

Ford

K. J.

(2002). Training in organizations: Needs assessment, development, & evaluation (4th ed.). Belmont, CA: Wadsworth.

42.

Gordon

V. N.

(1989). Origins and purposes of the freshman seminar. In Upcraft

M. L.

Gardner

J. N.

(Eds.), The freshman year experience: Helping students survive and succeed in college (pp. 183–197). San Francisco, CA: Jossey-Bass.

43.

Habley

W. R.

McClanahan

(2004). What works in student retention? Four-year private colleges. Retrieved from http://www.act.org/research/policymakers/pdf/droptables/FourYearPrivate.pdf

44.

Hales

L. W.

Bain

P. T.

Rand

L. P.

(1973). The pass-fail option: The congruence between the rationale for and student reasons in electing. Journal of Educational Research, 66, 295–298. doi:10.1080/00220671.1973.10884486

45.

Hatcher

Kryter

Prus

J. S.

Fitzgerald

(1992). Predicting college student satisfaction, commitment, and attrition from investment model constructs. Journal of Applied Social Psychology, 22, 1273–1296. doi:10.1111/j.1559-1816.1992.tb00950.x

46.

Hattie

Biggs

Purdie

(1996). Effects of learning skills interventions on student learning: A meta-analysis. Review of Educational Research, 66, 99–136. doi:10.3102/00346543066002099

47.

Hays

R. T.

Jacobs

J. W.

Prince

Salas

(1992). Requirements for future research in flight simulation training: Guidance based on a meta-analytic review. International Journal of Aviation Psychology, 2, 143–158. doi:10.1207/s15327108ijap0202_5

48.

Hedges

L. V.

Olkin

(1985). Statistical methods for meta-analysis. Orlando, FL: Academic Press.

49.

Hosch

B. J.

(2008, November). Institutional and student characteristics that predict graduation and retention rates. Paper presented at the North East Association for Institutional Research Annual Meeting, Providence, RI. Retrieved from http://web.ccsu.edu/oira/files/oira/20081104a.pdf

50.

Hunter

J. E.

Schmidt

F. L.

(1990). Methods of meta-analysis: Correcting error and bias in research findings. Newbury Park, CA: Sage.

51.

Hunter

J. E.

Schmidt

F. L.

(2004). Methods of meta-analysis: Correcting error and bias in research findings (2nd ed.). Newbury Park, CA: Sage.

52.

Hunter

M. A.

Linder

C. W.

(2005). First-year seminars. In Upcraft

M. L.

Gardner

J. N.

Barefoot

B. O.

(Eds.), Challenging and supporting the first-year student: A handbook for improving the first year of college (pp. 275–291). San Francisco, CA: Jossey-Bass.

53.

Janis

I. L.

(1983). Stress inoculation in health care: Theory and research. In Meichenbaum

Jaremko

M. E.

(Eds.), Stress reduction and prevention (pp. 67–99). New York, NY: Plenum.

54.

Johns

Saks

A. M.

(2014). Organizational behaviour: Understanding and managing life at work (9th ed.). Toronto, Ontario, Canada: Pearson.

55.

Johnson

J. L.

(1997). Commuter college students: What factors determine who will persist and who will dropout? College Student Journal, 31, 323–332.

56.

Karabenick

S. A.

(2003). Seeking help in large college classes: A person-centered approach. Contemporary Educational Psychology, 28, 37–58. doi:10.1016/S0361476X(02)00012-7

57.

Kena

Aud

Johnson

Wang

Zhang

Rathbun

. . . Kristapovich

(2014). The condition of education 2014 (NCES 2014-083). Retrieved from http://nces.ed.gov/pubs2014/2014083.pdf

58.

Kirkpatrick

D. L.

(1959). Techniques for evaluating training programs. Journal of the American Society of Training and Development, 13, 3–9.

59.

Kirkpatrick

D. L.

(1994). Evaluating training programs: The four levels. San Francisco, CA: Berrett-Koehler.

60.

Kraiger

(2003). Perspectives on training. In Borman

W. C.

Ilgen

D. R.

Klimoski

R. J.

(Eds.), Handbook of psychology: Industrial and organizational psychology (Vol. 12, pp. 171–192). New York, NY: Wiley.

61.

Kraiger

Ford

J. K.

Salas

(1993). Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. Journal of Applied Psychology, 78, 311–328. doi:10.1037/0021-9010.78.2.311

62.

Kuncel

N. R.

Hezlett

S. A.

(2007). Standardized tests predict graduate student success. Science, 315, 1080–1081. doi:10.1126/science.1136618

63.

Kuncel

N. R.

Ones

D. S.

Sackett

P. R.

(2010). Individual differences as predictors of work, educational, and broad life outcomes. Personality and Individual Differences, 49, 331–336. doi:10.1016/j.paid.2010.03.042

64.

Lazarus

R. S.

Folkman

(1984). Stress appraisal and coping. New York, NY: Springer.

65.

Levitz

Noel

Richter

(1999). Strategic moves for retention success. New Directions for Higher Education, 108, 31–49. doi:10.1002/he.10803

66.

Locke

E. A.

Latham

G. P.

(1990). A theory of goal setting and task performance. Englewood Cliffs, NJ: Prentice Hall.

67.

Lotkowski

V. A.

Robbins

S. B.

Noeth

R. J.

(2004). The role of academic and non-academic factors in improving college retention. Retrieved from http://www.act.org/research/policymakers/pdf/college_retention.pdf

68.

Lynch

Engle

(2010a). Big gaps, small gaps: Some colleges and universities do better than others in graduating African-American students. Retrieved from http://sparkaction.org/resources/38260

69.

Lynch

Engle

(2010b). Big gaps, small gaps: Some colleges and universities do better than others in graduating Hispanic students. Retrieved from http://sparkaction.org/resources/38261

70.

McAbee

S. T.

Oswald

F. L.

(2013). The criterion-related validity of personality measures for predicting GPA: A meta-analytic validity competition. Psychological Assessment, 25, 532–544. doi:10.1037/a0031748

71.

McGrath

R. E.

Meyer

G. J.

(2006). When effect sizes disagree: The case of r and d. Psychological Methods, 11, 386–401. doi:10.1037/1082-989X.11.4.386

72.

McLennan

R. N.

(1988). Correlation, base-rates, and the predictability of behavior. Personality and Individual Differences, 9, 675–684. doi:10.1016/0191-8869(88)90165-1

73.

Meichenbaum

(1996). Stress inoculation training for coping with stressors. The Clinical Psychologist, 49, 4–7.

74.

Mohr

(1995). Impact analysis for program evaluation (2nd ed.). Thousand Oaks, CA: Sage.

75.

Noel-Levitz. (2013). 2013 Student retention and college completion practices report for four-year and two-year institutions. Retrieved from https://www.noellevitz.com/upload/Papers_and_Research/2013/2013StudentRetentionPracticesReport.pdf

76.

Padgett

R. D.

Keup

J. R.

(2011). 2009 National survey of first-year seminars: Ongoing efforts to support students in transition (Research Reports on College Transitions No. 2). Columbia: University of South Carolina, National Resource Center for the First Year Experience and Students in Transition.

77.

Padgett

R. D.

Keup

J. R.

Pascarella

E. T.

(2013). The impact of first-year seminars on college students’ life-long learning orientations. Journal of Student Affairs Research and Practice, 50, 133–151. doi:10.1515/jsarp-2013-0011

78.

Pascarella

E. T.

(1980). Student-faculty informal contact and college outcomes. Review of Educational Research, 50, 545–595. doi:10.3102/00346543050004545

79.

Pascarella

E. T.

Terenzini

P. T.

(1976). Informal interaction with faculty and freshman ratings of academic and non-academic experiences of college. Journal of Educational Research, 70, 35–41. doi:10.1080/00220671.1976.10884944

80.

Pascarella

E. T.

Terenzini

P. T.

(1991). How college affects students: Findings and insights from twenty-years of research. San Francisco, CA: Jossey-Bass.

81.

Pascarella

E. T.

Terenzini

P. T.

(2005). How college affects students: A third decade of research (Vol. 2). San Francisco, CA: Jossey-Bass.

82.

Pintrich

P. R.

(2000). The role of goal orientation in self-regulated learning. In Boekaerts

Pintrich

P. R.

Zeidner

(Eds.), Handbook of self-regulation (pp. 451–502). San Diego, CA: Academic Press.

83.

Porter

L. W.

Steers

R. M.

(1973). Organizational, work, and personal factors in employee turnover and absenteeism. Psychological Bulletin, 80, 151–176. doi:10.1037/h0034829

84.

Price

(2005). Learning communities and student success in postsecondary education: A background paper. Retrieved from http://www.mdrc.org/sites/default/files/full_421.pdf

85.

Raisman

(2013). The cost of college attrition at four-year colleges and universities. Retrieved from http://www.educationalpolicy.org/pdf/1302_PolicyPerspectives.pdf

86.

Reilly

R. R.

Warech

M. A.

(1993). The validity and fairness of alternatives to cognitive tests. In Wing

L. C.

Gifford

B. R.

(Eds.), Policy issues in employment testing (pp. 131–224). Boston, MA: Kluwer.

87.

Robbins

S. B.

Lauver

Davis

Langley

Carlstrom

(2004). Do psychosocial and study skills factors predict college outcomes? A meta-analysis. Psychological Bulletin, 130, 261–288. doi:10.1037/0033-2909.130.2.261

88.

Rodriguez

P. D.

(2003). A study of three approaches to freshmen orientation and student success as compared to non-orientation student (Doctoral dissertation). Available from ProQuest Dissertations and Theses database. (UMI No. 3093094)

89.

Rotgans

Schmidt

(2009). Examination of the context-specific nature of self-regulated learning. Educational Studies, 35, 239–253. doi:10.1080/03055690802648051

90.

Rummel

Acton

Costello

Pielow

(1999). Is all retention good? An empirical study. College Student Journal, 33, 241–246.

91.

Sanchez-Meca

Marin-Martinez

(1998). Testing continuous moderators in meta-analysis: A comparison of procedures. British Journal of Mathematical and Statistical Psychology, 51, 311–326. doi:10.1111/j.2044-8317.1998.tb00683.x

92.

Schmidt

F. L.

(2004). Software for the Hunter–Schmidt meta-analysis methods [Computer software]. Iowa City: Department of Management and Organization, University of Iowa.

93.

Schuh

J. H.

Gansemer-Topf

(2012). Finances and retention: Trends and potential implications. In Seidman

(Ed.), College student retention: Formula for student success (pp. 101–118). Lanham, MD: Rowman & Littlefield.

94.

Shadish

W. R.

Cook

T. D.

Campbell

D. T.

(2002). Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin.

95.

Sidle

M. W.

McReynolds

(2009). The freshman year experience: Student retention and student success. Journal of Student Affairs Research and Practice, 46, 802–814. doi:10.2202/1949-6605.5019

96.

Simmons

Wallins

George

(1995). The effects of a freshman seminar on at-risk under-, over-, and low achievers. NACADA Journal, 15(1), 8–14. doi:10.12930/0271-9517-15.1.8

97.

Spady

(1970). Dropouts from higher education: An interdisciplinary review and synthesis. Interchange, 1, 64–85. doi:10.1007/BF02214313

98.

Sparks

Malkus

(2013). First-year undergraduate remedial coursetaking: 1999–2000, 2003–04, 2007–08 (NCES 2013-013). Retrieved from http://nces.ed.gov/pubs2013/2013013.pdf

99.

Stassen

M. A.

(2003). Student outcomes: The impact of varying living-learning community models. Research in Higher Education, 44, 581–604. doi:10.1023/A:1025495309569

100.

State Higher Education Executive Officers. (2014). State higher education finance, FY 2013. Retrieved from http://www.sheeo.org/sites/default/files/publications/SHEF_FY13_04292014.pdf

101.

Steel

Kammeyer-Mueller

(2002). Comparing meta-analytic moderator search techniques under realistic conditions. Journal of Applied Psychology, 87, 96–111. doi:10.1037/0021-9010.87.1.96

102.

Stone-Romero

E. F.

(2011). Research strategies in industrial and organizational psychology. In Zedeck

(Ed.), APA handbook of industrial and organizational psychology (Vol. 1, pp. 37–72). Washington, DC: American Psychological Association.

103.

Stricker

L. J.

Rock

D. A.

Burton

N. W.

Muraki

Jirele

T. J.

(1994). Adjusting college grade point average criteria for variations in grading standards: A comparison of methods. Journal of Applied Psychology, 79, 178–183. doi:10.1037/0021-9010.79.2.178

104.

Tebbe

C. M.

(2007). The effectiveness of a learning strategies course on college student-athletes’ and non-athletes’ adjustment, academic performance, and retention after the first two years of college (Doctoral dissertation). Available from ProQuest Dissertations and Theses database. (UMI No. 3300977)

105.

Tinto

(1975). Dropouts from higher education: A theoretical synthesis of the recent literature. Review of Educational Research, 45, 89–125. doi:10.3102/00346543045001089

106.

Tinto

(1993). Leaving college: Rethinking the causes and cures for student attrition (2nd ed.). Chicago, IL: University of Chicago Press.

107.

Turner

A. L.

Berry

T. R.

(2000). Counseling center contributions to student retention and graduation: A longitudinal assessment. Journal of College Student Development, 41, 627–636.

108.

Upcraft

M. L.

Gardner

J. N.

(Eds.). (1989). The freshman year experience: Helping students survive and succeed in college. San Francisco, CA: Jossey-Bass.

109.

Upcraft

M. L.

Gardner

J. N.

Barefoot

B. O.

(Eds.). (2005). Challenging & supporting the first-year student: A handbook for improving the first year of college. San Francisco, CA: Jossey-Bass.

110.

Venit

(2014, April 23). What can we learn from first year GPA? [Blog post]. Retrieved from http://www.eab.com/technology/student-success-collaborative/student-success-insights/2014/04/what-can-we-learn-from-first-year-gpa

111.

Wanous

J. P.

Poland

T. D.

Premack

S. L.

Davis

K. S.

(1992). The effects of met expectations on newcomer attitudes and behavior: A review and meta-analysis. Journal of Applied Psychology, 77, 288–297. doi:10.1037/0021-9010.77.3.288

112.

Weisgerber

J. E.

(2005). The impact of University 101 on freshman to sophomore retention rates at Urbana University (Doctoral dissertation). Available from ProQuest Dissertations and Theses database. (UMI No. 3151949)

113.

Wintre

M. G.

Bowers

C. D.

(2007). Predictors of persistence to graduation: Extending a model and data on the transition to university model. Canadian Journal of Behavioural Science, 39, 220–234. doi:10.1037/cjbs2007017

114.

Young

D. G.

Hopp

J. M.

(2014). 2012–2013 National survey of first-year seminars: Exploring high-impact practices in the first college year (Research Report No. 4). Columbia: University of South Carolina, National Resource Center for the First-Year Experience and Students in Transition.

115.

Zhao

Kuh

(2004). Adding value: Learning communities and student engagement. Research in Higher Education, 45, 115–138. doi:10.1023/B:RIHE.0000015692.88534.de

116.

Zimmerman

B. J.

(1990). Self-regulation and academic achievement: An overview. Educational Psychologist, 25, 3–17. doi:10.1207/s15326985ep2501_2