Advancing emotion recognition via EEG signals using a deep learning approach with ensemble model

Abstract

Human emotions are the mind’s responses to external stimuli, and due to their dynamic and unpredictable nature, research in this field has become increasingly important. There is a growing trend in utilizing deep learning and machine learning techniques for emotion recognition through EEG (electroencephalogram) signals. This paper presents an investigation based on a real-time dataset that comprises 15 subjects, consisting of 7 males and 8 females. The EEG signals of these subjects were recorded during exposure to video stimuli. The collected real-time data underwent preprocessing, followed by the extraction of features using various methods tailored for this purpose. The study includes an evaluation of model performance by comparing the accuracy and loss metrics between models applied to both raw and preprocessed data. The paper introduces the EEGEM (Electroencephalogram Ensemble Model), which represents an ensemble model combining LSTM (Long Short-Term Memory) and CNN (Convolutional Neural Network) to achieve the desired outcomes. The results demonstrate the effectiveness of the EEGEM model, achieving an impressive accuracy rate of 95.56%. This model has proven to surpass the performance of other established machine learning and deep learning techniques in the field of emotion recognition, making it a promising and superior tool for this application.