Online educational platforms increasingly allow learners to consume content at their own pace with on-demand formats, in contrast to the synchronous content of traditional education. Thus, it is important to understand and model learner engagement within these environments. Using data from four business courses hosted on Coursera, the authors model learner behavior as a two-stage decision process, with the first stage determining across-day continuation (vs. quitting) and the second stage determining within-day choices among lectures, quizzes, and breaks. By modeling the heterogeneity across learners pursuing lecture and quiz completion goals, the authors capture different patterns of consumption that correspond to extant theories of goal progress within an empirical field setting. They find that most individuals exhibit a learning style whereby lecture utility changes as an inverted U-shaped function of current progress. This model may also be used as an early detection system to anticipate changes in engagement, and it enables the authors to relate learning styles to final performance outcomes and enrollment in additional courses. Finally, the authors examine how quiz-taking varies across learners in different courses and between those who have paid versus not paid for the option to earn a course certificate.
AllenbyGreg M.AroraNeerajGinterJames L. (1998), “On the Heterogeneity of Demand,” Journal of Marketing Research, 35 (3), 384–89.
2.
BanerjeeAbhijit V.DufloEsther (2014), “(Dis)organization and Success in an Economics MOOC,” American Economic Review, 104 (5), 514–18.
3.
BonezziAndreaBrendaC. MiguelDe AngelisMatteo (2011), “Stuck in the Middle: The Psychophysics of Goal Pursuit,” Psychological Science, 22 (5), 607–12.
4.
CarabanAnaKarapanosEvangelosGonçalvesDanielCamposPedro (2019), “23 Ways to Nudge: A Review of Technology-Mediated Nudging in Human-Computer Interaction,” in Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. New York: Association for Computing Machinery, 1–15.
5.
CerasoliChristopher P.NicklinJessica M.FordMichael T. (2014). “Intrinsic Motivation and Extrinsic Incentives Jointly Predict Performance: A 40-Year Meta-Analysis,” Psychological Bulletin, 140 (4), 980–1008.
6.
CryderCynthia E.LoewensteinGeorgeSeltmanHoward (2013), “Goal Gradient in Helping Behavior,” Journal of Experimental Social Psychology, 49 (6), 1078–83.
7.
DavisDanChenGuanliangHauffClaudiaHoubenGeert-Jan (2016), “Gauging MOOC Learners’ Adherence to the Designed Learning Path,” in Proceedings of the 9th International Conference on Educational Data Mining. Raleigh NC: International Educational Data Mining Society, 54–61.
8.
De BarbaP.G.KennedyGregor E.AinleyM.D. (2016), “The Role of Students’ Motivation and Participation in Predicting Performance in a MOOC,” Journal of Computer Assisted Learning, 32 (3), 218–31.
9.
DeciEdward L.KoestnerRichardRyanRichard M. (2001), “Extrinsic Rewards and Extrinsic Motivation in Education: Reconsidered Once Again,” Review of Educational Research, 71 (1), 1–27.
10.
DimitrovaVaniaMitrovicAntonijaPiotrkowiczAlicjaLauLydiaWeerasingheAmali (2017), “Using Learning Analytics to Devise Interactive Personalised Nudges for Active Video Watching,” in Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization. New York: Association for Computing Machinery, 22–31.
11.
EcclesJacquelynne S.WigfieldAllan (2002), “Motivational Beliefs, Values, and Goals,” Annual Review of Psychology, 53 (1), 109–32.
12.
FaderPeter S.HardieBruce G.S.ShangJen (2010), “Customer-Base Analysis in a Discrete-Time Noncontractual Setting,” Marketing Science29 (6), 1086–1108.
13.
FangEricPalmatierRobert W.EvansKenneth R. (2004), “Goal-Setting Paradoxes? Trade-Offs Between Working Hard and Working Smart: The United States Versus China,” Journal of the Academy of Marketing Science, 32 (2), 188–202.
14.
FauconLouisKidzinskiLukaszDillenbourgPierre (2016), “Semi-Markov Model for Simulating MOOC Students,” in Proceedings of the 9th International Conference on Educational Data Mining. Raleigh NC: International Educational Data Mining Society, 358–63.
15.
FishbachAyletDharRaviZhangYing (2006), “Subgoals as Substitutes or Complements: The Role of Goal Accessibility,” Journal of Personality and Social Psychology, 91 (2), 232–42.
16.
GarveyAaron Michael (2012), “How Consumer Goal Characteristics Determine the Influence of Goal Progress on Goal Perseverance,” doctoral dissertation, Penn State University, https://etda.libraries.psu.edu/catalog/14987.
17.
GeigleChaseZhaiChengXiang (2017), “Modeling MOOC Student Behavior with Two-Layer Hidden Markov Models,” in Proceedings of the Fourth ACM Conference on Learning @ Scale. New York: Association for Computing Machinery, 206–08.
18.
GelmanAndrewCarlinJohn B.SternHal S.DunsonDavid B.VehtariAkiRubinDonald B. (2014), Bayesian Data Analysis, 3rd ed. Boca Raton, FL: CRC Press.
19.
GelmanAndrewMengXiao-LiSternHal (1996), “Posterior Predictive Assessment of Model Fitness via Realized Discrepancies,” Statistica Sinica, 6 (4), 733–807.
20.
GelmanAndrewRubinDonald B. (1992), “Inference from Iterative Simulation Using Multiple Sequences,” Statistical Science, 7 (4), 457–72.
21.
GilbrideTimothy J.AllenbyGreg M. (2004), “A Choice Model with Conjunctive, Disjunctive, and Compensatory Screening Rules,” Marketing Science, 23 (3), 391–406.
22.
GrantAdam M.SchwartzBarry (2011), “Too Much of a Good Thing: The Challenge and Opportunity of the Inverted U,” Perspectives on Psychological Science, 6 (1), 61–76.
23.
GuoPhilip J.ReineckeKatharina (2014), “Demographic Differences in How Students Navigate Through MOOCs,” in Proceedings of the First ACM Conference on Learning@ Scale. New York: Association for Computing Machinery, 21–30.
24.
HuangSzu-Chi (2018), “Social Information Avoidance: When, Why, and How It Is Costly in Goal Pursuit,” Journal of Marketing Research, 55 (3), 382–95.
25.
HullClark L (1932), “The Goal-Gradient Hypothesis and Maze Learning,” Psychological Review, 39 (1), 25–43.
26.
InmanJ. Jeffrey (2001), “The Role of Sensory-Specific Satiety in Attribute-Level Variety Seeking,” Journal of Consumer Research, 28 (1), 105–20.
27.
JerathKinshukFaderPeter S.HardieBruce G.S. (2011), “New Perspectives on Customer ‘Death’ Using a Generalization of the Pareto/NBD Model,” Marketing Science, 30 (5), 866–80.
28.
JhangJi HoonLynchJohn G.Jr. (2015), “Pardon the Interruption: Goal Proximity, Perceived Spare Time, and Impatience,” Journal of Consumer Research, 41 (5), 1267–83.
29.
KettleKeri L.TrudelRemiBlanchardSimon J.HäublGerald (2016), “Repayment Concentration and Consumer Motivation to Get Out of Debt,” Journal of Consumer Research, 43 (3), 460–77.
30.
KivetzRanUrminskyOlegZhengYuhuang (2006), “The Goal-Gradient Hypothesis Resurrected: Purchase Acceleration, Illusionary Goal Progress, and Customer Retention,” Journal of Marketing Research, 43 (1), 38–8.
31.
KizilcecRené F.Pérez-SanagustínMarMaldonadoJorge J. (2017), “Self-Regulated Learning Strategies Predict Learner Behavior and Goal Attainment in Massive Open Online Courses,” Computers & Education, 104, 18–33.
32.
KloftMariusStiehlerFelixZhengZhilinPinkwartNiels (2014), “Predicting MOOC Dropout over Weeks Using Machine Learning Methods,” in Proceedings of the EMNLP 2014 Workshop on Analysis of Large Scale Social Interaction in MOOCs. Stroudsburg, PA: Association for Computational Linguistics, 60–65.
33.
KooMinjungFishbachAyelet (2008), “Dynamics of Self-Regulation: How (Un)Accomplished Goal Actions Affect Motivation,” Journal of Personality and Social Psychology, 94 (2), 183–95.
34.
McAlisterLeigh (1982), “A Dynamic Attribute Satiation Model of Variety-Seeking Behavior,” Journal of Consumer Research, 9 (2), 141–50.
35.
McFaddenDaniel (1978), “Modelling of Choice of Residential Location,” in Spatial Interaction Theory and Residential Location, KarlqvistA.SnickarsF.WeibullJ., eds. Amsterdam: North-Holland, 75–96.
36.
McSweeneyFrances K.SwindellSamantha (1999), “General-Process Theories of Motivation Revisited: The Role of Habituation,” Psychological Bulletin, 125 (4), 437–57.
37.
MehtaNitinRajivSurendraSrinivasanKannan (2003), “Price Uncertainty and Consumer Search: A Structural Model of Consideration Set Formation,” Marketing Science, 22 (1), 58–84.
38.
MorganMark (1985), “Self-Monitoring of Attained Subgoals in Private Study,” Journal of Educational Psychology, 77 (6), 623–30.
39.
MusalemAndrésOlvaresMarceloBradlowEric T.TerwieschChristianCorstenDaniel (2010), “Structural Estimation of the Effect of Out-of-Stocks,” Management Science, 56 (7), 1180–97.
40.
NelsonLeif D.MeyvisTom (2008), “Interrupted Consumption: Disrupting Adaptation to Hedonic Experiences,” Journal of Marketing Research, 45 (6), 654–64.
41.
NelsonLeif D.MeyvisTomGalakJeff (2009), “Enhancing the Television-Viewing Experience Through Commercial Interruptions,” Journal of Consumer Research, 36 (2), 160–72.
42.
NewmanJoseph W.StaelinRichard (1972), “Prepurchase Information Seeking for New Cars and Major Household Appliances,” Journal of Marketing Research, 9 (3), 249–57.
43.
NunesJoseph C.DrèzeXavier (2006), “The Endowed Progress Effect: How Artificial Advancement Increases Effort,” Journal of Consumer Research, 32 (4), 504–12.
44.
ParkJihyunDenaroKamerynRodriguezFernandoSmythPadhraicWarschauerMark (2017), “Detecting Changes in Student Behavior from Clickstream Data,” in Proceedings of the Seventh International Learning Analytics & Knowledge Conference. New York: Association for Computing Machinery, 21–30.
45.
RameshArtiGoldwasserDanHuangBertDauméHalIIIGetoorLise (2013), “Modeling Learner Engagement in MOOCs Using Probabilistic Soft Logic,” presented at NIPS Workshop on Data Driven Education (December 9), Lake Tahoe, NV.
46.
ReddenJoseph P.GalakJeff (2013), “The Subjective Sense of Feeling Satiated,” Journal of Experimental Psychology: General, 142 (1), 209–17.
47.
SchunkDale H. (1990), “Goal Setting and Self-Efficacy During Self-Regulated Learning,” Educational Psychologist, 25 (1), 71–86.
48.
ShiCongleiFuSiweiChenQingQuHuamin (2015), “VisMOOC: Visualizing Video Clickstream Data from Massive Open Online Courses,” in 2015 IEEE Pacific Visualization Symposium (PacificVis). Paris: IEEE, 159–66.
49.
SinhaTanmayLiNanJermannPatrickDillenbourgPierre (2014), “Capturing ‘Attrition Intensifying’ Structural Traits from Didactic Interaction Sequences of MOOC Learners,” in Proceedings of the EMNLP 2014 Workshop on Analysis of Large Scale Social Interaction in MOOCs. Stroudsburg, PA: Association for Computational Linguistics, 42–49.
50.
SinharaySandipSternHal S. (2003), “Posterior Predictive Model Checking in Hierarchical Models,” Journal of Statistical Planning and Inference, 111 (1/2), 209–21.
51.
SwaitJoffreArgoJenniferLiLianhua (2018), “Modeling Simultaneous Multiple Goal Pursuit and Adaptation in Consumer Choice,” Journal of Marketing Research, 55 (3), 352–67.
52.
Touré-TilleryMaferimaFishbachAyelet (2012), “The End Justifies the Means, but Only in the Middle,” Journal of Experimental Psychology: General, 141 (3), 570–83.
53.
Touré-TilleryMaferimaFishbachAyelet (2014), “How to Measure Motivation: A Guide for the Experimental Social Psychologist,” Social and Personality Psychology Compass, 8 (7), 328–41.
54.
UetakeKosukeYangNathan (2020), “Inspiration from the ‘Biggest Loser’: Social Interactions in a Weight Loss Program,” Marketing Science, 39 (3), 459–665.
55.
VanceRobert J.ColellaAdrienne (1990), “Effects of Two Types of Feedback on Goal Acceptance and Personal Goals,” Journal of Applied Psychology, 75 (1), 68–76.
56.
WilkowskiJuliaDeutschAmitRussellDaniel M. (2014), “Student Skill and Goal Achievement in the Mapping with Google MOOC,” in Proceedings of the First ACM Conference on Learning @ Scale. New York: Association for Computing Machinery, 3–10.
57.
WoolleyKaitlinFishbachAyelet (2016), “For the Fun of It: Harnessing Immediate Rewards to Increase Persistence in Long-Term Goals,” Journal of Consumer Research, 42 (6), 952–66.
58.
YangDiyiSinhaTanmayAdamsonDavidRoséCarolyn Penstein (2013), “Turn On, Tune In, Drop Out: Anticipating Student Dropouts in Massive Open Online Courses,” paper presented at NIPS Workshop on Data-Driven Education (December, Lake Tahoe, NV).
59.
ZaubermanGalLynchJohn G.Jr. (2005), “Resource Slack and Propensity to Discount Delayed Investments of Time Versus Money,” Journal of Experimental Psychology: General, 134 (1), 23–37.
60.
ZimmermanBarry J.BanduraAlbertMartinez-PonsManuel (1992), “Self-Motivation for Academic Attainment: The Role of Self-Efficacy Beliefs and Personal Goal Setting,” American Educational Research Journal, 29 (3), 663–76.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
