The case for metacognition support in a flipped STEM course

Abstract

The metacognitive strategies of planning, monitoring, and evaluating can be promoted through systematic reflection to drive self-directed, lifelong learning. This article reports on a three-year study on systematic written reflection within an undergraduate Fluid Mechanics course to promote planning, monitoring, and evaluation. Students were prompted weekly to reflect on their in-class problem-solving, classroom and exam preparation, performance, behaviors, and learning in a flipped classroom at a large southeastern U.S. university. In addition, they received intentional instruction on how to plan, monitor, and evaluate their problem-solving during class. To enable a comparative assessment, a flipped classroom without these interventions was also implemented as a non-experimental cohort. The cohorts were compared using a final exam, concept inventory, and the Metacognitive Activities Inventory (MCAI). The MCAI indicated a significantly higher positive change (pre- to post-course) in self-regulatory behavior for the experimental cohort (p = 0.037). The weekly reflections were studied using an inductive content analysis to assess students’ self-regulatory behaviors. They were also used to investigate statistical associations between reflection content and course outcomes. This revealed that academic self-discipline via planning, monitoring one's work, or being careful and diligent may be as aligned with course performance in STEM as is practice with the problem-solving itself. The effects for the final exam in the experimental cohort were positive overall as well as statistically or practically significant for various demographic strata. These results provided evidence for the potential enhancement of course performance with metacognition support. A positive shift in students’ perspectives regarding the value of the reflection questions was observed throughout the study. Therefore, as an implementation guide for other educators, the reflection questions and any changes made in posing them to students are discussed chronologically. Overall, the study points to the desirability of providing metacognition support in a STEM course.

Keywords

Metacognition reflection flipped fluid mechanics

Get full access to this article

View all access options for this article.

References

Ambrose

. Undergraduate engineering curriculum: The ultimate design challenge. Bridge (Kans City) 2013; 43: 16–23.

Cunningham

Matusovich

Hunter

, et al. Teaching metacognition: Helping engineering students take ownership of their own learning. In: Proceedings of IEEE frontiers in education conference, El Paso, TX, 2015.

Marra

Kim

Plumb

, et al. Beyond the technical: Developing lifelong learning and metacognition for the engineering workplace. In: Proceedings of ASEE annual conference, Columbus, OH, 2017.

Clark R, Kaw A and Guldiken R. Metacognition instruction and repeated reflection in a fluid mechanics course: Reflective themes and student outcomes. Int J Mech Eng Educ 2023; 51: 243–269.

Schraw

. Promoting general metacognitive awareness. Instr Sci 1998; 26: 113–125.

Wengrowicz

Dori

. Metacognition and meta-assessment in engineering education. In: Dori

Mevarech

Baker

(eds) Cognition, metacognition, and culture in STEM education. Switzerland: Springer International, 2018, pp.191–215.

Bishop-Clark

Dietz-Uhler

. Engaging in the scholarship of teaching and learning. Sterling, VA: Stylus Publishing, 2012, p.10.

Pintrich

. The role of metacognitive knowledge in learning, teaching, and assessing. Theory Pract 2002; 41: 219–225.

Tanner

. Promoting student metacognition. CBE—Life Sci Educ 2012; 11: 113–120.

10.

Veenman

. Metacognition in science education: Definitions, constituents, and their intricate relation with cognition. In: Zohar

Dori

(eds) Metacognition in Science Education: Trends in Current Research. Dordrecht: Springer Netherlands, 2012, pp.21–36.

11.

Jaiswal

Lyon

Zhang

, et al. Supporting student reflective practices through modelling-based learning assignments. Eur J Eng Educ 2021; 46: 987–1006.

12.

Evans

. Windmills of your mind: Metacognition and lifelong learning. In: Proceedings of the Canadian engineering education association (CEEA) conference, Vancouver, BC, 2018.

13.

Singh

Diefes-Dux

. Pairing self-evaluation activities with self-reflection to engage students deeply in multiple metacognition strategies. In: Proceedings of ASEE annual conference & exposition, Baltimore, MD, 2023.

14.

Marra

Hacker

Plumb

. Metacognition and the development of self-directed learning in a problem-based engineering curriculum. J Eng Educ 2022; 111: 137–161.

15.

Privitera

Ahlgrim-Delzell

. Research Methods for Education. Thousand Oakes, CA: Sage Publications, 2019, pp.188–189.

16.

Bergmann

Sams

. Flip your classroom reach every student in every class every day. Eugene, OR: International Society for Technology in Education, 2012.

17.

Kember

McKay

Sinclair

, et al. A four-category scheme for coding and assessing the level of reflection in written work. Assess Eval High Educ 2008; 33: 369–379.

18.

Clark R, Moss M, Kaw A, et al. Community as “surroundings” in a classroom ecosystem. In: Proceedings of ASEE Annual Conference and Exposition, Baltimore, MD, 2023.

19.

Clark R, Moss M, Uyanik O, et al. Community of inquiry as “surroundings” in a flipped classroom ecosystem: COVID-19 effect? J Furth High Educ 2024 (Under review).

20.

Neuendorf

. The Content Analysis Guidebook. Thousand Oaks, CA: Sage Publications, 2002, pp.158–159.

21.

Geisler

Swarts

. Coding Streams of Language: Techniques for the Systematic Coding of Text, Talk, and Other Verbal Data. Ft. Collins, CO: WAC Clearinghouse, 2019, p.172.

22.

Landis

Koch

. The measurement of observer agreement for categorical data. Biometrics 1977; 33: 159–174.

23.

Cooper

Sandi-Urena

. Design and validation of an instrument to assess metacognitive skillfulness in chemistry problem solving. J Chem Educ 2009; 86: 240–245.

24.

Norusis

. SPSS 14.0 statistical procedures companion. Upper Saddle River, NJ: Prentice Hall, 2005, 138–139, 430, 439–442, 445.

25.

Martin

Mitchell

Newell

. Development of a concept inventory for fluid mechanics. In: Proceedings of IEEE Frontiers in Education Conference, Boulder, CO, 2003.

26.

Quade

. Rank analysis of covariance. J Am Stat Assoc 1967; 62: 1187–1200.

27.

Lawson

. Rank analysis of covariance: Alternative approaches. Statistician 1983; 32: 331–337.

28.

Bland

Altman

. Multiple significance tests: The Bonferroni method. Br Med J 1995; 310: 170.

29.

Perneger

. What’s wrong with Bonferroni adjustments. Br Med J 1998; 316: 1236–1238.

30.

Theobald

Hill

Tran

, et al. Active learning narrows achievement gaps for underrepresented students in undergraduate science, technology, engineering, and math. Proc Natl Acad Sci USA 2020; 117: 6476–6483.

31.

Agresti

Finlay

. Statistical Methods for the Social Sciences. Upper Saddle River, NJ: Prentice Hall, 1997, pp. 216–220, 224.

32.

Sullivan

Feinn

. Using effect size-or why the p value is not enough. J Grad Med Educ 2012; 4: 279–282.