Abstract
Emotion detection in educational dialogues, particularly within student-teacher interactions, has become a crucial research area for improving the learning experience. In this paper, we employ two models, one generic Bidirectional Encoder Representations from Transformers (BERT) and the Emotion detection model Robustly Optimized BERT Approach (EmoRoBERTa), to automatically classify emotions in a corpus of student-teacher chat interactions. Then subsequently, we validate these classifications using a scheme based on oracles, employing two generative large language models (ChatGPT and Bard). Experiments on emotion detection in dialogues between students and teachers revealed that EmoRoBERTa exhibited a reasonable level of agreement with the oracles, while ChatGPT demonstrated the highest consistency with EmoRoBERTa’s predictions. Furthermore, we identified the impact of specific words on emotion classification, offering insights into the decision-making process of these models. The results not only highlight the prominent presence of emotions like
Get full access to this article
View all access options for this article.
