ELINA: Emotion low-resources INference algorithm based on 1D ConvNets

Abstract

In this study, a thorough analysis of the proposed approach in the context of emotion classification using both single-modal (A-13sbj) and multi-modal (B-12sbj) sets from the YAAD dataset was conducted. This dataset encompassed 25 subjects exposed to audiovisual stimuli designed to induce seven distinct emotional states. Electrocardiogram (ECG) and galvanic skin response (GSR) biosignals were collected and classified using two deep learning models, BEC-1D and ELINA, along with two different preprocessing techniques, a classical fourier-based filtering and an Empirical Mode Decomposition (EMD) approach. For the single-modal set, this proposal achieved an accuracy of 84.43±30.03, precision of 85.16±28.91, and F1-score of 84.06±29.97. Moreover, in the extended configuration the model maintained strong performance, yielding scores of 80.95±22.55, 82.44±24.34, and 79.91±24.55, respectively. Notably, for the multi-modal set (B-12sbj), the best results were obtained with EMD preprocessing and the ELINA model. This proposal achieved an improved accuracy, precision, and F1-score scores of 98.02±3.78, 98.31±3.31, and 97.98±3.83, respectively, demonstrating the effectiveness of this approach in discerning emotional states from biosignals.