“I Feel Like Talking With a Friend”: Exploring the Potential of Empathetic Spoken Dialogue Systems in Assessing Interactional Competence in L2 Oral Assessment

Abstract

As an important area of exploration within spoken dialogue systems (SDSs), empathetic spoken dialogue systems (E-SDSs) can provide emotional support for interlocutors, and this feature has the potential to be embedded in language teaching, learning, and assessment. However, the potential of E-SDSs in second language (L2) oral assessment remains underexplored, particularly regarding their ability to elicit interactional competence (IC) and learners’ perceptions of the two systems. To address these gaps, this study compares learners’ interaction with a neutral spoken dialogue system (N-SDS) with limited empathetic capability as a reference condition and an E-SDS, with an aim to explore its potential for L2 oral assessment. Twenty-five L2 learners completed two tasks (E-SDS and N-SDS). Their oral performances between the two tasks were examined in terms of IC features, and their perceptions of the E-SDS were also investigated through semi-structured interviews. Results indicated the E-SDS tends to elicit higher frequencies of certain IC features. Learners generally perceived the E-SDS as a competent, trustworthy, and emotionally supportive interlocutor, but certain concerns were also expressed concerning system design and technical limitations.