Personalized learning path based on graph attention mechanism deep reinforcement learning research on recommender systems

Abstract

In e-learning, the rapid expansion of learning resources poses challenges for learners in finding suitable materials due to their diverse preferences and cognitive abilities. Consequently, personalized learning path recommendation has emerged as a pivotal research area, especially for advancing e-learning systems. This paper introduces an algorithmic framework that integrates deep reinforcement learning with a graph attention mechanism to tailor learning paths to individual learners. The online course dataset is selected and a series of controlled experiments are conducted on the common recommendation models proposed in the past, and the experimental results are analyzed using a combination of two evaluation indices, such as data evaluation results and model variance. The experimental results show that adding the attention mechanism can significantly improve the accuracy of the model recommendation, compared with the deep reinforcement learning model without adding the graph attention mechanism, the comprehensive scores of the students in the test set were improved by 5.8 and 12.8 points, respectively, and the accuracy was improved by 5.3% compared with the previous deep learning model; the deep reinforcement model used in this paper with the addition of the labeling feedback mechanism was improved by 5.3% compared with the deep learning with feedback mechanism. In the recommendation model, the final scores of the students were improved by 3.7 and 8.2 points, respectively. In addition, the Advanced test set in the recommendation model of the learning path recommended by the student score improvement is more than two times of the Middle test set’s scores improvement, indicating that more learning recommended object knowledge points the richer, the model recommendation accuracy rate is higher. By merging graph attention mechanisms with deep reinforcement learning, our system provides precise recommendations, offering insights into the development of efficient personalized learning path systems and accelerating their educational applications.

Keywords

personalized learning path deep reinforcement learning recommendation algorithms graph attention mechanism

Get full access to this article

View all access options for this article.

References

Wang

Zhang

, et al. A personalized learning path recommendation method incorporating multi-algorithm. Appl Sci 2023; 13: 5946.

Truong

. Integrating learning styles and adaptive e-learning system: Current developments, problems and opportunities. Comput Hum Behav 2016; 55(55): 1185–1193.

Nabizadeh

Leal

Rafsanjani

, et al. Learning path personalization and recommendation methods: A survey of the state-of-the-art. Expert Syst Appl 2020; 159: 113596.

Bray

McClaskey

. A step-by-step guide to personalize learning. Learn Lead Technol 2013; 40: 12–19.

Mansouri

Nesrine

Soui

Makram

Abed

Mourad

. Full personalized learning path recommendation: A literature review. Proceedings of the 9th international conference on advanced intelligent systems and informatics. Cham: Springer, 2023, pp. 185–195.

Zhang

Liu

Wang

. Personalized learning path recommendation for E-learning based on knowledge graph and graph convolutional network. Int J Software Eng Knowl Eng 2022; 33(33): 109–131.

Cai

Zhang

Dai

. Learning path recommendation based on knowledge tracing model and reinforcement learning. In: 2019 IEEE 5th International Conference on Computer and Communications (ICCC), Chengdu, China, 06–09 December 2019, pp. 1881–1885.

Wang

Hao

Cao

. ADRL: An attention-based deep reinforcement learning framework for knowledge graph reasoning. Knowl Base Syst 2020; 197: 105910.

Shareef

Jimson

Jose

. Hybrid explainable educational recommender using self-attention and knowledge-based systems for E-learning in MOOC platforms. Responsible Data Science 2022; 940: 61–74.

10.

Zhou

Huang

, et al. Personalized learning full-path recommendation model based on LSTM neural networks. Inf Sci 2018; 444: 135–152.

11.

Raj

Renumol

. An improved adaptive learning path recommendation model driven by real-time learning analytics. J Comput Educ 2024; 11(11): 121–148.

12.

Ahmadian Yazdi

Seyyed Mahdavi

Ahmadian Yazdi

. Dynamic educational recommender system based on Improved LSTM neural network. Sci Rep 2024; 14(14): 4381.

13.

Benmesbah

Lamia

Hafidi

. An improved constrained learning path adaptation problem based on genetic algorithm. Interact Learn Environ 2023; 31(31): 3595–3612.

14.

Zhang

Zhan

, et al. Semi-supervised classification of graph convolutional networks with Laplacian rank constraints. Neural Process Lett 2022; 54(54): 2645–2656.

15.

Feng

Gao

Song

, et al. Modeling multi-targets sentiment classification via graph convolutional networks and auxiliary relation. Comput Mater Continua (CMC) 2020; 64(64): 909–923.

16.

Wang

Cui

Zhang

, et al. Neighbor-augmented knowledge graph attention network for recommendation. Neural Process Lett 2023; 55(6): 8237–8253.

17.

Sun

, et al. LNGAT: local neighborhood graph attention network. J Electron Imag 2022; 31: 053034.

18.

Chen

Yao

McAuley

, et al. Deep reinforcement learning in recommender systems: A survey and new perspectives. Knowl Base Syst 2023; 264: 110335.

19.

Arulkumaran

Deisenroth

Brundage

, et al. Deep reinforcement learning: A brief survey. IEEE Signal Process Mag 2017; 34(34): 26–38.

20.

Hui

Luo

. Graph attention networks with local structure awareness for knowledge graph completion. IEEE Access 2020; 8(8): 224860–224870.

21.

Zhao

Liu

, et al. Graph contextualized self-attention network for session-based recommendation. Proceedings of the 28th International Joint Conference on Artificial Intelligence 2019; 1: 3940–3946.

22.

Zhang

Gao

, et al. Personalized graph neural networks with attention mechanism for session-aware recommendation. IEEE Trans Knowl Data Eng 2020; 34(34): 3946–3957.

23.

Zhang

Yao

Sun

, et al. Deep learning based recommender system: A survey and new perspectives. ACM Comput Surv 2019; 52: 1–38.

24.

Basiliyos

Charles

Bernabe

. Deep learning methods on recommender system: A survey of state-of-the-art. Int J Comput Appl 2017; 162: 17–22.

25.

Zhang

Wang

, et al. Research on personalized learning model under informatization environment. In: 2017 international symposium on educational technology, Hong Kong, China, 27–29 June 2017, pp. 48–52.

26.

Yang

Yuan

Zhang

. The research of personalized learning system based on learner interests and cognitive level. In: 2014 9th international conference on computer science & education, Vancouver, BC, Canada, 22–24 August 2014, pp. 522–526.

27.

Ghazali

ASM

Noor

SFM

Saad

. Review of personalized learning approaches and methods in e-learning environment. In: 2015International Conference on Electrical Engineering and Informatics, Denpasar, Indonesia, 10–11 August 2015, pp. 624–627.

28.

Ghiasabadi Farahani

Akbari Torkestani

Rahmani

. Adaptive personalized recommender system using learning automata and items clustering. Inf Syst 2022; 106(106): 101978.

29.

Zhang

Hao

Chen

, et al. Hierarchical reinforcement learning for course recommendation in MOOCs. Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence and Thirty-First Innovative Applications of Artificial Intelligence Conference and Ninth AAAI Symposium on Educational Advances in Artificial Intelligence 2019; 54: 435–442.

30.

Frej

Shah

Knezevic

, et al. Finding paths for explainable MOOC recommendation: A learner perspective. Proceedings of the 14th Learning Analytics and Knowledge Conference 2024; 12: 426–437.