Intelligent learners distraction and drowsiness prediction through EEG signal and iris angel position with brain vision algorithm

Abstract

Distraction and fatigue are serious issues in online learning, and they directly impact educational outcomes. To achieve excellent academic achievement, students need to focus on their studies without being distracted or fatigued. Learners frequently overlook crucial information, directions, and concepts while they are passive and sleepy. They tend to miss important content, instructions, and concepts. Iris Angle Position (IAP) and electroencephalography (EEG) were used in this model to identify the behaviour of learners. Specifically, a Deep Convolutional Neural Network (DCNN) is constructed to extract IAP in order to accurately capture the learner’s facial area. EEG signals are effectively handled and sorted using deep reinforcement learning (DRL). The learners’ facial landmarks are retrieved from a frame using the dlib toolbox. Only eye landmark points from face landmarks alone are focused on in order to determine the learner’s behaviour. When the learners EEG signals and Iris positions are monitored simultaneously, it’s helpful to identify the learner’s fatigue state (LFS) and the learner’s distraction state (LDS). The Brain Vision Algorithm (BVA) uses iris position and minimal facial landmarks, along with brain activity, to properly identify the learner’s level of distraction and exhaustion. When a student is detected as being preoccupied or sleepy, an alert goes off automatically, and the educator gets performance feedback. Iris position data and brain-computer interface-based EEG signal values are utilised to identify distraction and sleepiness. Comparative tests have demonstrated that this innovative method offers fast and high-accuracy student activity detection in virtual learning settings. Applying the suggested approach to different existing classifiers yields an F-Score of 91.92%, a recall of 93.87%, and a precision of 92.37% . The results showed that the detection rates for both distracted and sleepy phases were higher than those attained with other currently used techniques.