Emotions,Motivation,Cognitive–Metacognitive Strategies,and Behavior as Predictors of Learning Performance in Blended Learning

Abstract

Several studies have focused on identifying the significant behavioral predictors of learning performances in web-based courses by examining the log data variables of learning management systems, including time spent on lectures, the number of assignments submitted, and so forth. However, such studies fail to quantify the impact of emotional, motivational, behavioral, and cognitive–metacognitive factors simultaneously. This research was an attempt to understand the relations between students’ motivation, cognitive–metacognitive strategies, behavior, and learning performance in the context of blended courses in higher education. Then, relevant predictors are used to obtain a model to classify the students’ performance and to identify those who are at risk of failing the course. The authors conducted an empirical study in a higher educational course with 137 Mexican students. Nineteen variables related to emotions, motivation, cognitive–metacognitive strategies, and behavior. Only six were found to be significant. These variables explain approximately 67% of the variance between each student’s overall grade. The model, based on those variables, correctly classifies 96% of the students.

Keywords

blended learning higher education emotions motivation cognitive–metacognitive strategies learning performance

Get full access to this article

View all access options for this article.

References

Advanced Distributed Learning. (2004). SCORM (sharable content object reference model) 4th edition. Retrieved from http://adlnet.gov/adl-research/scorm/scorm-2004-4th-edition/.

Al-Harthy

I. S.

Was

C. A.

Isaacson

R. M.

(2010) Goals, efficacy and metacognitive self-regulation: A path analysis. International Journal of Education 2(1): 1.

Anderman

E. M.

Dawson

(2011) Learning with motivation. In: Mayer

R. E.

Alexander

P. A.

(eds) Handbook of research on learning and instruction, New York, NY: Routledge, pp. 219–241.

Asociación Nacional de Universidades e Instituciones de Educación Superior (2015) Anuario Estadístico 2014-2015, Mexico City, Mexico: Author.

Azevedo

Moos

D. C.

Greene

J. A.

Winters

F. I.

Cromley

J. G.

(2008) Why is externally-facilitated regulated learning more effective than self-regulated learning with hypermedia? Educational Technology Research and Development 56(1): 45–72. doi:10.1007/s11423-007-9067-0.

Baker

R. S. J. D.

D’Mello

S. K.

Rodrigo

M. M. T.

Graesser

A. C.

(2010) Better to be frustrated than bored: The incidence, persistence, and impact of learners’ cognitive–affective states during interactions with three different computer-based learning environments. International Journal of Human-Computer Studies 68(4): 223–241. doi:10.1016/j.ijhcs.2009.12.003.

Burgos

Campanario

M. L.

Peña

D. D. L.

Lara

J. A.

Lizcano

Martínez

M. A.

(2018) Data mining for modeling students’ performance: A tutoring action plan to prevent academic dropout. Computers & Electrical Engineering. 66, 541–556. doi:10.1016/j.compeleceng.2017.03.005.

Cerezo

Sánchez-Santillán

Paule-Ruiz

M. P.

Núñez

J. C.

(2016) Students’ LMS interaction patterns and their relationship with achievement: A case study in higher education. Computers & Education 96: 42–54. doi:10.1016/j.compedu.2016.02.006.

Cho

M.-H.

Heron

M. L.

(2015) Self-regulated learning: The role of motivation, emotion, and use of learning strategies in students’ learning experiences in a self-paced online mathematics course. Distance Education 36(1): 80–99. doi:10.1080/01587919.2015.1019963.

10.

Craig

Graesser

Sullins

Gholson

(2004) Affect and learning: An exploratory look into the role of affect in learning with AutoTutor. Journal of Educational Media 29(3): 241–250. doi:10.1080/1358165042000283101.

11.

Demˇsar

(2006) Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research 7. (2006), 1–30.

12.

D’Mello

Graesser

(2012) Dynamics of affective states during complex learning. Learning and Instruction 22(2): 145–157. doi:10.1016/j.learninstruc.2011.10.001.

13.

D’Mello

Lehman

Pekrun

Graesser

(2014) Confusion can be beneficial for learning. Learning and Instruction 29: 153–170. doi:10.1016/j.learninstruc.2012.05.003.

14.

D’Mello

S. K.

Craig

S. D.

Witherspoon

McDaniel

Graesser

(2008) Automatic detection of learner’s affect from conversational cues. User Modeling and User-Adapted Interaction 18(1): 45–80. doi:10.1007/s11257-007-9037-6.

15.

Elias

Mustaf

S. M. S.

Roslan

Noah

S. M.

(2011) Motivational predictors of academic performance in end year examination. Procedia - Social and Behavioral Sciences 29: 1179–1188. doi:10.1016/j.sbspro.2011.11.352.

16.

Fayyad

Piatetsky-Shapiro

Smyth

(1996) The KDD process for extracting useful knowledge from volumes of data. Communications of the ACM 39(11): 27–34. doi:10.1145/240455.240464.

17.

González

Fernández

M.-V. C.

Paoloni

P.-V.

(2017) Hope and anxiety in physics class: Exploring their motivational antecedents and influence on metacognition and performance. Journal of Research in Science Teaching 54(5): 558–585. doi:10.1002/tea.21377.

18.

Graham, C. R. (2005). Blended learning systems: Definition, current trends, and future directions. In C. J. Bonk & C. R. Graham (Eds.), The handbook of blended learning: Global perspectives, local designs (pp. 3–21). San Francisco, CA: Pfeiffer Publishing.

19.

Hall

Frank

Holmes

Pfahringer

Reutemann

Witten

I. H.

(2009) The WEKA data mining software: An update. ACM SIGKDD Explorations Newsletter 11(1): 10–18. doi:10.1145/1656274.1656278.

20.

Harding, A., Kaczynski, D., & Wood, L. (2005). Evaluation of blended learning: Analysis of qualitative data. Paper presented at the UniServe Science Blended Learning Symposium, September, Sydney, Australia.

21.

Hembree

(1988) Correlates, causes, effects, and treatment of test anxiety. Review of Educational Research 58(1): 47–77. doi:10.3102/00346543058001047.

22.

Hirumi

(2002) The design and sequencing of e-learning interactions: A grounded approach. International Journal on E-Learning 1: 19–27.

23.

Horton

N. J.

Kleinman

K. P.

(2007) Much ado about nothing: A comparison of missing data methods and software to fit incomplete data regression models. The American Statistician 61(1): 79–90. doi:10.1198/000313007X172556.

24.

Kim

Park

S. W.

Cozart

(2014) Affective and motivational factors of learning in online mathematics courses. British Journal of Educational Technology 45(1): 171–185. doi:10.1111/j.1467-8535.2012.01382.x.

25.

Kim

Park

S. W.

Cozart

Lee

(2015) From motivation to engagement: The role of effort regulation of virtual high school students in mathematics courses. Educational Technology & Society 18(4): 261–272.

26.

Kramarski

Gutman

(2006) How can self-regulated learning be supported in mathematical E-learning environments? Journal of Computer Assisted Learning 22(1): 24–33. doi:10.1111/j.1365-2729.2006.00157.x.

27.

Lara

J. A.

Lizcano

Martínez

M. A.

Pazos

Riera

(2014) A system for knowledge discovery in e-learning environments within the European Higher Education Area – Application to student data from Open University of Madrid, UDIMA. Computers & Education 72: 23–36.

28.

Lehman

D’Mello

Graesser

(2012) Confusion and complex learning during interactions with computer learning environments. The Internet and Higher Education 15(3): 184–194. doi:10.1016/j.iheduc.2012.01.002.

29.

Linnenbrink

E. A.

(2007) Chapter 7 – The role of affect in student learning: A multi-dimensional approach to considering the interaction of affect, motivation, and engagement. In: Schutz

P. A.

Pekrun

(eds) Emotion in education, Burlington, NJ: Academic Press, pp. 107–124.

30.

Linnenbrink-Garcia

Patall

E. A.

Pekrun

(2016) Adaptive motivation and emotion in education. Policy Insights from the Behavioral and Brain Sciences 3(2): 228–236. doi:10.1177/2372732216644450.

31.

Lynch

D. J.

(2010) Motivational beliefs and learning strategies as predictors of academic performance in college physics. College Student Journal 44: 920–927.

32.

(1999) A meta-analysis of the relationship between anxiety toward mathematics and achievement in mathematics. Journal for Research in Mathematics Education 30: 520–540.

33.

Marchand

G. C.

Gutierrez

A. P.

(2012) The role of emotion in the learning process: Comparisons between online and face-to-face learning settings. The Internet and Higher Education 15(3): 150–160. doi:10.1016/j.iheduc.2011.10.001.

34.

Marquez-Vera

Morales

C. R.

Soto

S. V.

(2013) Predicting school failure and dropout by using data mining techniques. Tecnologias del Aprendizaje, IEEE Revista Iberoamericana de 8(1): 7–14. doi:10.1109/rita.2013.2244695.

35.

Matthews

(1997) An introduction to the cognitive science of personality and emotion. In: Stelmach

G. E.

Vroon

E. A.

(eds) Advances in psychology Vol. 124, Amsterdam, the Netherlands: Elsevier.

36.

Mega

Ronconi

De Beni

(2014) What makes a good student? How emotions, self-regulated learning, and motivation contribute to academic achievement. Journal of Educational Psychology 106(1): 121–131. doi:10.1037/a0033546.

37.

Meyers

L. S.

Gamst

Guarino

A. J.

(2006) Applied multivariate research: Design and interpretation, Thousand Oaks, CA: SAGE Publications.

38.

Pekrun

(2006) The control-value theory of achievement emotions: Assumptions, corollaries, and implications for educational research and practice. Educational Psychology Review 18(4): 315–341. doi:10.1007/s10648-006-9029-9.

39.

Pekrun

Elliot

A. J.

Maier

M. A.

(2006) Achievement goals and discrete achievement emotions: A theoretical model and prospective test. Journal of Educational Psychology 98(3): 583–597. doi:10.1037/0022-0663.98.3.583.

40.

Pekrun

Elliot

A. J.

Maier

M. A.

(2009) Achievement goals and achievement emotions: Testing a model of their joint relations with academic performance. Journal of Educational Psychology 101(1): 115–135. doi:10.1037/a0013383.

41.

Pekrun

Frenzel

A. C.

Goetz

Perry

R. P.

(2007) The control-value theory of achievement emotions: An integrative approach to emotions in education. In: Schutz

P. A.

Pekrun

(eds) Educational psychology series. Emotion in education, Burlington, NJ: Academic Press, pp. 13–36.

42.

Pekrun

Goetz

Titz

Perry

R. P.

(2002) Academic emotions in students’ self-regulated learning and achievement: A program of qualitative and quantitative research. Educational Psychologist 37(2): 91–105. doi:10.1207/s15326985ep3702_4.

43.

Pekrun

Stephens

E. J.

(2010) Achievement emotions: A control-value approach. Social and Personality Psychology Compass 4(4): 238–255. doi:10.1111/j.1751-9004.2010.00259.x.

44.

Peña-Ayala

(2014) Educational data mining: A survey and a data mining-based analysis of recent works. Expert Systems with Applications 41(4, Part 1): 1432–1462. doi:10.1016/j.eswa.2013.08.042.

45.

Pintrich

P. R.

(1991) A manual for the use of the motivated strategies for learning questionnaire (MSLQ), Ann Arbor, MI: University of Michigan; Washington, DC: U.S. Dept. of Education, Office of Educational Research and Improvement, Educational Resources Information Center.

46.

Pintrich

P. R.

de Groot

E. V.

(1990) Motivational and self-regulated learning components of classroom academic performance. Journal of Educational Psychology 82(1): 33–40. doi:10.1037/0022-0663.82.1.33.

47.

Pons, F., Rosnay, M. D., & Cuisinier, F. (2011). Cognition and emotion. In V. G. Aukrust (Ed.), Learning and cognition in education (pp. 78–84). Amsterdam, the Netherlands: Elsevier.

48.

Romero

López

M.-I.

Luna

J.-M.

Ventura

(2013) Predicting students’ final performance from participation in on-line discussion forums. Computers & Education 68: 458–472. doi:10.1016/j.compedu.2013.06.009.

49.

Romero

Ventura

(2010) Educational data mining: A review of the state of the art. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) 40(6): 601–618. doi:10.1109/TSMCC.2010.2053532.

50.

Rooney

J. E.

(2003) Blending learning opportunities to enhance educational programming and meetings. Association Management 55(5): 26–32.

51.

Rovai

A. P.

Baker

J. D.

Ponton

M. K.

(2013) Social science research design and statistics: A practitioner’s guide to research methods and IBM SPSS, Chesapeake, VA: Watertree Press.

52.

Scheirer

C. J.

Ray

W. S.

Hare

(1976) The analysis of ranked data derived from completely randomized factorial designs. Biometrics 32(2): 429–434. doi:10.2307/2529511.

53.

Schunk

D. H.

Pintrich

P. R.

Meece

J. L.

(2008) Motivation in education: Theory, research, and applications, Upper Saddle River, NJ: Pearson/Merrill Prentice Hall.

54.

Secretaría de Educación Pública. (2015). Sistema Educativo de los Estados Unidos Mexicanos. Principales Cifras Ciclo escolar 2014–2015 [Educational System of the United States of Mexico. Main Figures of the 2014-2015 school year]. Mexico City, Mexico: Secretaría de Educación Pública.

55.

Skinner

Furrer

Marchand

Kindermann

(2008) Engagement and disaffection in the classroom: Part of a larger motivational dynamic? Journal of Educational Psychology 100(4): 765–781. doi:10.1037/a0012840.

56.

Stegers-Jager

K. M.

Cohen-Schotanus

Themmen

A. P. N.

(2012) Motivation, learning strategies, participation and medical school performance. Medical Education 46(7): 678–688. doi:10.1111/j.1365-2923.2012.04284.x.

57.

Traver

A. E.

Volchok

Bidjerano

Shea

(2014) Correlating community college students’ perceptions of community of inquiry presences with their completion of blended courses. The Internet and Higher Education 20(2014): 1–9. doi:10.1016/j.iheduc.2013.09.001.

58.

Wellborn

J. G.

(1991) Engaged and disaffected action: The conceptualization and measurement of motivation in the academic domain, Rochester, NY: University of Rochester.

59.

Woltering

Herrler

Spitzer

Spreckelsen

(2009) Blended learning positively affects students’ satisfaction and the role of the tutor in the problem-based learning process: Results of a mixed-method evaluation. Advances in Health Sciences Education 14(5): 725. doi:10.1007/s10459-009-9154-6.

60.

You

J. W.

(2015) Examining the effect of academic procrastination on achievement using LMS data in e-learning. Educational Technology & Society 18(3): 64–74.

61.

You

J. W.

(2016) Identifying significant indicators using LMS data to predict course achievement in online learning. The Internet and Higher Education 29: 23–30. doi:10.1016/j.iheduc.2015.11.003.

62.

Young

(2002) Hybrid teaching seeks to end the divide between traditional and online instruction. The Chronicle of Higher Education: Information Technology 48(28): A33–A34.

63.

Zacharis

N. Z.

(2015) A multivariate approach to predicting student outcomes in web-enabled blended learning courses. The Internet and Higher Education 27: 44–53. doi:10.1016/j.iheduc.2015.05.002.