The proliferation of educational technology systems has led to the advent of a large number of datasets related to learner interaction. New fields have emerged which aim to use this data to identify interventions that could help the learners become efficient and effective in their learning. However, these systems have to follow user-centered design principles to ensure that the system is usable and the data is of high quality. Human factors literature is limited on the topics regarding Educational Data Mining (EDM) and Learning Analytics (LA). To develop improved educational systems, it is important for human factors engineers to be exposed to these data-oriented fields. This paper aims to provide a brief introduction to the fields of EDM and LA, discuss data visualization and dashboards that are used to convey results to learners, and finally to identify where human factors can aid other fields.
ArnoldK. E.PistilliM. D. (2012). Course signals at Purdue: Using learning analytics to increase student success. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 267-270). ACM.
3.
BakerR. J. d. (2013). Learning, schooling, and data analytics. In MurphyM.ReddingS.TwymanJ. (Eds.), Handbook on innovations in learning (pp. 179-190). Philadelphia, PA: Center on Innovations in Learning, Temple University; Charlotte, NC: Information Age Publishing.
4.
BliksteinP.WorsleyM. (2016). Multimodal Learning Analytics and Education Data Mining: Using computational technologies to measure complex learning tasks. Journal of Learning Analytics, 3(2), 220-238.
5.
Buckingham-ShumS.GasevicD.FergusonR. (Eds.). (2012). Proceedings of the 2nd International Conference on Learning Analytics and Knowledge. ACM.
6.
CardS.MackinlayJ.ShneidermanB. (1999). Readings in information visualization: Using vision to think. San Francisco, CA: Morgan Kaufmann.
7.
CarnahanB.MeyerG.KuntzL.-A. (2003). Comparing statistical and machine learning classifiers: Alternatives for predictive modeling in human factors research. Human Factors, 45(3), 408–423.
8.
DrachslerH.GrellerW. (2016). Privacy and analytics: It’s a DELICATE issue a checklist for trusted learning analytics. In Proceedings of the 6th International Conference on Learning Analytics and Knowledge (pp. 89-98). ACM.
9.
FergusonR. (2012). Learning analytics: Drivers, developments and challenges. International Journal of Technology Enhanced Learning, 4(5/6), 304-317.
10.
FewS. (2006). Information dashboard design: The effective visual communication of data (1st ed.). Cambridge, MA: O’Reilly.
11.
FewS. (2013). Information dashboard design: Displaying data for at-a-glance monitoring (vol. 5). Burlingame, CA: Analytics Press.
12.
Frias-MartinezE.ChenS. Y.LiuX. (2006). Survey of data mining approaches to user modeling for adaptive hypermedia. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 36(6), 734-749.
13.
GarciaE.RomeroC.VenturaS.GeaM.De CastroC. (2009). Collaborative Data Mining Tool for Education. International Working Group on Educational Data Mining.
14.
GrellerW.DrachslerH. (2012). Translating Learning into Numbers: A Generic Framework for Learning Analytics. Journal of Educational Technology & Society, 15(3), 42–57.
15.
HannonD.RantanenE.SawyerB.PtuchaR.HughesA.DarveauK.LeeJ. D. (2019). A Human Factors Engineering Education Perspective on Data Science, Machine Learning and Automation. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 63(1), 488–492.
16.
JivetI.ScheffelM.SpechtM.DrachslerH. (2018). License to evaluate: Preparing learning analytics dashboards for educational practice. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge (pp. 31-40). ACM.
17.
KeimD. A. (2002). Information visualization and visual data mining. IEEE Transactions on Visualization and Computer Graphics, 8(1), 1-8.
18.
KevanJ. M.Sorensen IrvineC. K. (2017). Academic technology for competency-based education in higher education. In RasmussenK.NorthrupP.ColsonR. (Eds.), Handbook of research on competency- based education in university settings (pp. 116-134). Hershey, PA: IGI Global.
19.
KlerkxJ.VerbertK.DuvalE. (2017). Learning Analytics Dashboards. In LangC.SiemensG.WiseA. F.GasevicD. (Eds.), The Handbook of Learning Analytics. (1st ed., pp. 143-150).
20.
LaneyD. (2001). 3D data management: Controlling data volume, velocity and variety. META group research note, 6(70), 1.
21.
LauN.FridmanL.BorghettiB. J.LeeJ. D. (2018). Machine Learning and Human Factors: Status, Applications, and Future Directions. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 62(1), 135–138.
22.
MaJ.DruryC. G. (2003). The Human Factors Issues in Data Mining. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 47(4), 716–720.
23.
MurphyJ.HanniganF.HruskaM.MedfordA.DiazG. (2016). Leveraging interoperable data to improve training effectiveness using the Experience API (xAPI). In International Conference on Augmented Cognition (pp. 46-54). Springer, Cham.
24.
OchoaX. (2017). Multimodal Learning Analytics. In LangC.SiemensG.WiseA. F.GasevicD. (Eds.), The Handbook of Learning Analytics. (1st ed., pp. 129-141).
25.
PapamitsiouZ.EconomidesA. A. (2014). Learning analytics and educational data mining in practice: A systematic literature review of empirical evidence. Journal of Educational Technology & Society, 17(4), 49-64.
26.
PardoA.SiemensG. (2014). Ethical and privacy principles for learning analytics. British Journal of Educational Technology, 45(3), 438-450.
27.
RomeroC.VenturaS. (2013). Data mining in education. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 3(1), 12-27.
28.
Ruipérez-ValienteJ. A.Muñoz-MerinoP. J.LeonyD.KloosC. D. (2015). ALAS-KA: A learning analytics extension for better understanding the learning process in the Khan Academy platform. Computers in Human Behavior, 47, 139-148.
29.
ShneidermanB. (1996). The eyes have it: A task by data type taxonomy for information visualizations. In Proceedings 1996 IEEE Symposium on Visual Languages (pp. 336-343). IEEE.
30.
SiemensG.d BakerR. S. (2012). Learning analytics and educational data mining: towards communication and collaboration. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 252-254). ACM.
31.
SladeS.PrinslooP. (2013). Learning Analytics: Ethical Issues and Dilemmas. American Behavioral Scientist, 57(10), 1510–1529.
32.
VerbertK.DuvalE.KlerkxJ.GovaertsS.SantosJ. L. (2013). Learning analytics dashboard applications. American Behavioral Scientist, 57(10), 1500-1509.
33.
VerbertK.GovaertsS.DuvalE.SantosJ. L.AsscheF.ParraG.KlerkxJ. (2014). Learning dashboards: An overview and future research opportunities. Personal and Ubiquitous Computing, 18(6), 1499-1514.
34.
WautersK.DesmetP.Van Den NoortgateW. (2011). Acquiring item difficulty estimates: A collaborative effort of data and judgment. In Proceedings of the 4th International Conference on Educational Data Mining (pp. 121-127). Eindhoven University of Technology.
35.
Yet Analytics. (2019). Data analytics and visualization environment for xAPI and the total learning architecture: DAVE learning analytics algorithms. ADL.
36.
YooY.LeeH.JoI. H.ParkY. (2015). Educational dashboards for smart learning: Review of case studies. In Emerging Issues in Smart Learning (pp. 145-155). Springer, Berlin, Heidelberg.
