Using Self-Organizing Map and Clustering to Investigate Problem-Solving Patterns in the Massive Open Online Course: An Exploratory Study

Abstract

This study investigated whether clustering can identify different groups of students enrolled in a massive open online course (MOOC). This study applied self-organizing map and hierarchical clustering algorithms to the log files of a physics MOOC capturing how students solved weekly homework and quiz problems to identify clusters of students showing similar problem-solving patterns. The usefulness of the identified clusters was verified by examining various characteristics of students such as number of problems students attempted to solve, weekly and daily problem completion percentages, and whether they earned a course certificate. The findings of this study suggest that the clustering technique utilizing self-organizing map and hierarchical clustering algorithms in tandem can be a useful exploratory data analysis tool that can help MOOC instructors identify similar students based on a large number of variables and examine their characteristics from multiple perspectives.

Keywords

massive open online course Educational Data Mining log file analysis self-organizing map clustering

Get full access to this article

View all access options for this article.

References

Ahmad

N. B.

Ishak

M. K.

Alias

U. F.

Mohamad

(2015) An approach for e-learning data analytics using SOM clustering. International Journal of Advances in Soft Computing & Its Application 7(3): 94–112.

Antonenko

P. D.

Toy

Niederhauser

D. S.

(2012) Using cluster analysis for data mining in educational technology research. Educational Technology Research and Development 60(3): 383–398.

Baker, R. (2010). Data mining for education. In B. McGaw, P. Peterson, & E. Baker (Eds.), International Encyclopedia of Education (3rd ed., pp. 112–118). Oxford, UK: Elsevier Science.

Balint

T. A.

Teodorescu

Colvin

Choi

Y.-J.

Pritchard

(2017) Physics instructional resource usage by high-, medium-, and low-skilled MOOC students. The Physics Teacher 55(4): 222–225.

Breslow

Pritchard

D. E.

DeBoer

J. D.

Stump

G. S.

A. D.

Seaton

D. T.

(2013) Studying learning in the worldwide classroom: Research into edX's first MOOC. Research Practice in Assessment 8: 13–25.

Caliński

Harabasz

(1974) A dendrite method for cluster analysis. Communications in Statistics 3(1): 1–27.

Class Central. (2015). By the numbers: MOOCS in 2015 – Class Central's MOOC report. Retrieved from https://www.class-central.com/report/moocs-2015-stats/.

Durfee

Schneberger

Amoroso

D. L.

(2007) Evaluating students computer-based learning using a visual data mining approach. Journal of Informatics Education Research 9: 1–28.

Ezen-Can, A., Boyer, K. E., Kellogg, S., & Booth, S. (2015). Unsupervised modeling for understanding MOOC discussion forums: A learning analytics approach. Proceedings of the 5th International Conference on Learning Analytics and Knowledge. Retrieved from http://doi.acm.org/10.1145/2723576.2723589.

10.

Ferguson

Clow

(2016) Consistent commitment: Patterns of engagement across time in Massive Open Online Courses (MOOCs). Journal of Learning Analytics 2(3): 55–80.

11.

Haykin

(1999) Neural Networks, 2nd ed. Upper Saddle River, NJ: Prentice Hall.

12.

Ho, A. D., Reich, J., Nesterko, S. O., Seaton, D. T., Mullaney, T., Waldo, J., & Chuang, I. (2014). HarvardX and MITx: The first year of open online courses, fall 2012-summer 2013. SSRN Electronic Journal. doi:10.2139/ssrn.2381263.

13.

Jordan

(2014) Initial trends in enrolment and completion of massive open online course. The International Review of Research in Open and Distributed Learning 15(1): 133–160.

14.

Jordan

(2015) Massive open online course completion rates revisited: Assessment, length and attrition. The International Review of Research in Open and Distributed Learning 16(3): doi:10.19173/irrodl.v16i3.2112.

15.

Khalil

Ebner

(2017) Clustering patterns of engagement in Massive Open Online Courses (MOOCs): The use of learning analytics to reveal student categories. Journal of Computing in Higher Education 29(1): 114–132.

16.

Kizilcec, R. F., Piech, C., & Schneider, E. (2013). Deconstructing disengagement: Analyzing learner subpopulations in massive open online courses. Proceedings of the 3rd International Conference on Learning Analytics and Knowledge. Retrieved from http://doi.acm.org/10.1145/2460296.2460330.

17.

Lee

C.-S.

(2007) Diagnostic, predictive and compositional modeling with data mining in integrated learning environments. Computers & Education 49(3): 562–580.

18.

Kidzinski

Jermann

Dillenbourg

(2015) MOOC video interaction patterns: What do they tell us? Lecture Notes in Computer Science 9307(6): 197–210.

19.

Liu, Z., Brown, R., Lynch, C., Barnes, T., Baker, R., Bergner, Y., & McNamara, D. (2016). MOOC Learner Behaviors by Country and Culture; an Exploratory Analysis. Proceedings of the 9th International Conference on Educational Data Mining. Retrieved from https://pdfs.semanticscholar.org/3c0a/68193049732f890b0632ed72d6e19d5119e8.pdf?_ga=2.84644377.1215507837.1515768297-87580748.1508175188.

20.

Merelo-Gervos, J. J., Perieto, B., Prierto, A., Romero, G., Valdivieso, P. C., & Tricas, F. (2004). Clustering web-based communities using self-organizing maps. Proceedings of IADIS Conference on Web Based Communities. Retrieved from https://pdfs.semanticscholar.org/f58b/1caa38e5673d6d533da16ba567034e1c27a7.pdf?_ga=2.139507507.1215507837.1515768297-87580748.1508175188.

21.

Peña-Ayala

(2014) Educational data mining: A survey and a data mining-based analysis of recent works. Expert Systems with Applications 41(P1): 1432–1462.

22.

Reich, J. R. (2014). MOOC completion and retention in the context of student intent [EDUCAUSE Review Online]. Retrieved from http://www.educause.edu/ero/article/mooc-completion-and-retention-context-student-intent.

23.

Rodrigues, R. L., Gomes, A. S., Souza, F. F., Ramos, J. L. C., Silva, J. C. S., & Maciel, A. M. A. (2016). Discovering level of participation in MOOCs through clusters analysis. Proceedings of the IEEE 16th International Conference on Advanced Learning Technologies. doi: 10.1109/ICALT.2016.45.

24.

Romero

Ventura

(2010) Educational data mining: A review of the state of the art. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) 40(6): 601–618.

25.

Vesanto

Alhoniemi

(2000) Clustering of the self-organizing map. IEEE Transactions on Neural Networks 11(3): 586–600.

26.

Wehrens

Buydens

L. M. C.

(2007) Self- and super-organizing maps in R: The Kohonen package. Journal of Statistical Software 21(5): 1–19.