Exploring Critical Thinking as an Outcome for Students Enrolled in Community Colleges

Abstract

Objective: Using data from HEIghten^® Critical Thinking, a student learning outcomes assessment, the purpose of this study was to evaluate what variables are associated with higher critical thinking performance for students enrolled in various community college programs and to evaluate performance differences across demographic and college-level subgroups as well as student perceptions. Method: With data from 1,307 students enrolled across 34 U.S. and Canadian higher education institutions (72% enrolled in 2-year institutions), we utilized a hierarchical regression to identify variables associated with critical thinking performance. Critical thinking performance differences were evaluated using analyses of variance (ANOVAs) and t-tests across student demographic and college experience subgroups and across student perceptions. Results: Results of this study showed (a) consistent significant predictors associated with higher critical thinking performance; (b) a positive relationship between critical thinking performance and the frequency of using critical thinking in college courses; (c) significant, but relatively small performance differences across demographic and college experience subgroups; and (d) positive relationships between student perceptions and critical thinking performance. Conclusion: This study added to the limited literature evaluating critical thinking skills for community college students. Overall, results suggest that institutions should focus attention to the frequency at which students are using critical thinking throughout their courses, which could increase student performance in this particular area, especially if critical thinking is an explicit outcome within the course. Results also suggested the need to emphasize critical thinking skills more across various community college programs and across non-STEM-focused programs. Suggestions for future research are discussed.

Keywords

critical thinking community colleges learning outcomes subgroup differences

Get full access to this article

View all access options for this article.

References

Abrami

P. C.

Bernard

R. M.

Borokhovski

Wade

Surkes

M. A.

Tamim

Zhang

(2008). Instructional interventions affecting critical thinking skills and dispositions: A stage 1 meta-analysis. Review of Educational Research, 78(4), 1102–1134. https://doi.org/10.3102/0034654308326084

American Association of Community Colleges. (2019a, March). AACC fast facts 2019. https://www.aacc.nche.edu/wp-content/uploads/2019/05/AACC2019FactSheet_rev.pdf

American Association of Community Colleges. (2019b). Driving success. VFA summary report: Leading indicators of success and student outcomes for community colleges. https://www.aacc.nche.edu/wp-content/uploads/2019/04/VFA_Summary_Report_2019.pdf

American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing.

American Management Association. (2012). AMA 2012 critical skills survey. https://www.amanet.org/assets/1/6/2012-critical-skills-survey.pdf

Ayers

D. F.

(2015). Credentialing structure, pedagogies, practices, and curriculum goals: Trajectories of change in community college mission statements. Community College Review, 43(2), 191–214. https://doi.org/10.1177/0091552115569847

Bailey

T. R.

Jaggars

S. S.

Jenkins

(2015). Redesigning America’s community colleges. Harvard University Press. https://doi.org/10.4159/9780674425934

Bandura

(1997). Self-efficacy: The exercise of control. W.H. Freeman.

Baumert

Demmrich

(2001). Test motivation in the assessment of student skills: The effects of incentives on motivation and performance. European Journal of Psychology of Education, 16(3), 441–462. https://doi.org/10.1007/bf03173192

10.

Binkley

Erstad

Herman

Raizen

Ripley

Rumble

(2012). Defining 21st century skills. In Griffin

McGaw

Care

(Eds.), Assessment and teaching of 21st century skills (pp. 17–66). Springer. https://doi.org/10.1007/978-94-007-2324-5

11.

Butler

H. A.

(2012). Halpern Critical Thinking Assessment predicts real-world outcomes of critical thinking. Applied Cognitive Psychology, 26(5), 721–729. https://doi.org/10.1002/acp.2851

12.

Casner-Lotto

Barrington

(2006). Are they really ready to work? Employers’ perspectives on the basic knowledge and applied skills of new entrants to the 21st century U.S. workforce. Partnership for 21st Century Skills. https://files.eric.ed.gov/fulltext/ED519465.pdf

13.

Chemers

M. M.

Garcia

B. F.

(2001). Academic self-efficacy and first-year college student performance and adjustment. Journal of Educational Psychology, 93(1), 55–64. https://doi.org/10.1037/0022-0663.93.1.55

14.

Cohen

A. M.

Brawer

F. B.

(2008). The American community college (5th ed.). John Wiley.

15.

Cohen

A. M.

Brawer

F. B.

Kisker

C. B.

(2014). The American community college (6th ed.). John Wiley.

16.

Cohen

(1988). Statistical power analysis for the behavioral sciences. Lawrence Erlbaum. https://doi.org/10.4324/9780203771587

17.

The College Board. (2019). Community college: FAQs. https://bigfuture.collegeboard.org/find-colleges/how-to-find-your-college-fit/community-college-faqs

18.

Community College Review. (2019, March 26). What is a community college? [Online forum post]. https://www.communitycollegereview.com/blog/what-is-a-community-college

19.

Council for Aid to Education. (2019). About CLA+. https://cae.org/flagship-assessments-cla-cwra/cla/about-cla/

20.

de Brey

Musu

McFarland

Wilkinson-Flicker

Diliberti

Zhang

Branstetter

Wang

. (2019, February). Status and trends in the education of racial and ethnic groups 2018 (NCES 2019-038). National Center for Education Statistics, U.S. Department of Education. https://nces.ed.gov/pubs2019/2019038.pdf

21.

Desai

S. A.

(2012). Is comprehensiveness taking its toll on community colleges? An in-depth analysis of community colleges’ missions and their effectiveness. Community College Journal of Research and Practice, 36(2), 111–121. https://doi.org/10.1080/10668920802611211

22.

Dougherty

K. J.

Townsend

B. K.

(2006). Community college missions: A theoretical and historical perspective. New Directions for Community Colleges, 136, 5–13. https://doi.org/10.1002/cc.254

23.

Educational Testing Service. (2018a). About the HEIghten® outcomes assessment suite. https://www.ets.org/heighten/about

24.

Educational Testing Service. (2018b). HEIghten® outcomes assessment suite: Guide to score interpretation.

25.

Educational Testing Service. (2019). HEIghten® critical thinking assessment. https://www.ets.org/heighten/about/critical_thinking/

26.

Facione

N. C.

Facione

P. A.

Sanchez

C. A.

(1994). Critical thinking disposition as a measure of competent clinical judgment: The development of the California Critical Thinking Disposition Inventory. Journal of Nursing Education, 33(8), 345–350. https://doi.org/10.3928/0148-4834-19941001-05

27.

Facione

P. A.

(1990). The California Critical Thinking Skills Test-college level. Technical report #2. Factors predictive of skills. California Academic Press. https://files.eric.ed.gov/fulltext/ED327550.pdf

28.

Facione

P. A.

Facione

N. C.

(1992). The California Critical Thinking Dispositions Inventory. California Academic Press.

29.

Finn

(2015). Measuring motivation in low-stakes assessments (Report No. RR-15-19). Educational Testing Service. https://files.eric.ed.gov/fulltext/EJ1109280.pdf

30.

Fong

C. J.

Kim

Davis

C. W.

Hoang

Kim

Y. W.

(2017). A meta-analysis on critical thinking and community college student achievement. Thinking Skills and Creativity, 26, 71–83. https://doi.org/10.1016/j.tsc.2017.06.002

31.

Gall

M. D.

Borg

W. R.

Gall

J. P.

(2007). Educational research: An introduction (8th ed.). Pearson Education.

32.

Halpern

D. F.

(2003). Thought and knowledge: An introduction to critical thinking (4th ed.). Lawrence Erlbaum. https://doi.org/10.4324/9781410606433

33.

Halpern

D. F.

(2010). Halpern Critical Thinking Assessment manual. Schuhfried GmbH. https://drive.google.com/file/d/0BzUoP_pmwy1gdEpCR05PeW9qUzA/view

34.

Hart Research Associates. (2015). Falling short? College learning and career success. Association of American Colleges and Universities. https://www.aacu.org/sites/default/files/files/LEAP/2015employerstudentsurvey.pdf

35.

Hart Research Associates. (2016). Recent trends in general education design, learning outcomes, and teaching approaches. Association of American Colleges and Universities. https://www.aacu.org/sites/default/files/files/LEAP/2015_Survey_Report2_GEtrends.pdf

36.

Hauser

Kingsbury

G. G.

(2009, April 14–16). Individual score validity in a modest-stakes adaptive educational testing setting [Paper presentation]. Annual Meeting of the National Council on Measurement in Education, San Diego, CA, United States.

37.

Huber

C. R.

Kuncel

N. R.

(2016). Does college teach critical thinking? A meta-analysis. Review of Educational Research, 86(2), 431–468. https://doi.org/10.3102/0034654315605917

38.

Kena

Musu-Gillete

Robinson

Wang

Rathbun

Zhang

. . . Ballard

(2015, May). The condition of education 2015 (NCES 2015-144). National Center for Education Statistics, U.S. Department of Education. https://nces.ed.gov/pubs2015/2015144.pdf

39.

Laitinen

(2012, September). Cracking the credit hours. New America Foundation. https://files.eric.ed.gov/fulltext/ED.pdf540304

40.

Liu

O. L.

Frankel

Roohr

K. C.

(2014). Assessing critical thinking in higher education: Current state and directions for next generation assessment (Report No. RR-14-10). Educational Testing Service. https://files.eric.ed.gov/fulltext/EJ1109287.pdf

41.

Liu

O. L.

Mao

Frankel

(2016). Assessing critical thinking in higher education: The HEIghten™ approach and preliminary validity evidence. Assessment & Evaluation in Higher Education, 41(5), 677–694. https://doi.org/10.4324/9781351260480-3

42.

Liu

O. L.

Roohr

K. C.

(2013). Investigating 10-year trends of learning outcomes at community colleges (Report No. RR-13-34). Educational Testing Service. https://www.ets.org/Media/Research/pdf/RR-13-34.pdf

43.

Liu

O. L.

Shaw

. . . Loyalka

(2018). Assessing college critical thinking: Preliminary results from the Chinese HEIghten® Critical Thinking Assessment. Higher Education Research & Development, 37(5), 999–1014. https://doi.org/10.1080/07294360.2018.1467381

44.

Lynam

Cachia

(2018). Students’ perceptions of the role of assessments at higher education. Assessment & Evaluation in Higher Education, 43(2), 223–234. https://doi.org/10.1080/02602938.2017.1329928

45.

Marin

Halpern

D. F.

(2011). Pedagogy for developing critical thinking in adolescents: Explicit instruction produces greatest gains. Thinking Skills and Creativity, 6(1), 1–13. https://doi.org/10.1016/j.tsc.2010.08.002

46.

Multon

K. D.

Brown

S. D.

Lent

R. W.

(1991). Relation of self-efficacy beliefs to academic outcomes: A meta-analytic investigation. Journal of Counseling Psychology, 38(1), 30–38. https://doi.org/10.1037//0022-0167.38.1.30

47.

National Association of Colleges and Employers. (2018, November). Job outlook 2019. https://www.odu.edu/content/dam/odu/offices/cmc/docs/nace/2019-nace-job-outlook-survey.pdf

48.

National Institute for Learning Outcomes Assessment. (2011). Transparency framework. https://www.learningoutcomesassessment.org/ourwork/transparency-framework/

49.

Nunley

Bers

Manning

(2011, July). Learning outcomes assessment in community colleges (Occasional Paper No. 10). National Institute for Learning Outcomes Assessment. https://www.learningoutcomesassessment.org/documents/CommunityCollege.pdf

50.

Pascarella

Bohr

Nora

Terenzini

(1994). Cognitive effects of two-year and four-year colleges: Some new evidence. Office of Educational Research and Improvement. https://files.eric.ed.gov/fulltext/ED371678.pdf

51.

Quality Assurance Agency. (2008, August). The framework for higher education qualifications in England, Wales and Northern Ireland. https://www.ncl.ac.uk/ltds/assets/documents/qsh-progapp-fheqsummary.pdf

52.

Research for Action. (2019, February). Measuring the effectiveness of outcomes-based funding on certificate production: Challenges, inconsistencies and recommendations for future research [Research brief]. https://files.eric.ed.gov/fulltext/ED593699.pdf

53.

Rhodes

T. L.

(Ed.). (2010). Assessing outcomes and improving achievement: Tips and tools for using rubrics. Association of American Colleges and Universities.

54.

Rios

J. A.

Liu

O. L.

Bridgeman

(2014). Identifying unmotivated examinees on student learning outcomes assessment: A comparison of two approaches. New Directions for Institutional Research, 161, 69–82. https://doi.org/10.1002/ir.20068

55.

Sykes

(2012). Defining and reporting subbaccalaureate certificates in IPEDS (NPEC 2012-835). National Postsecondary Education Cooperative, U.S. Department of Education. https://nces.ed.gov/pubs2012/2012835.pdf

56.

Voluntary Framework of Accountability. (2013). Community college measures of effectiveness. American Association of Community Colleges. https://vfa.aacc.nche.edu/Documents/VFABrochureLowResolution.pdf

57.

Wise

S. L.

Kong

(2005). Response time effort: A new measure of examinee motivation in computer-based tests. Applied Measurement in Education, 18(2), 163–183. https://doi.org/10.1207/s15324818ame1802_2

58.

Zhang

Oymak

(2018). Participants in subbaccalaureate occupational education: 2012 (NCES 2018-149). National Center for Education Statistics. https://nces.ed.gov/pubs2018/2018149.pdf