The impact of AI chatbots (ChatGPT) on EFL learners’ writing fluency and accuracy

Abstract

This paper discusses how chatbots (in the case of ChatGPT) can be used to improve the fluency and accuracy of writing among English as a Foreign Language (EFL) learners. The quasi experimental design was used involving 400 intermediate level students in the Department of English Language and Literature, College of Languages and Humanities in Qassim University, Saudi Arabia. The study was conducted with equal division into an experimental and control group, with the former group being provided with ChatGPT as an auxiliary tool when working on writing exercises and the latter being taught in a traditional way, without AI assistance. The performance improvements were measured by using pre-test and post-test writing tasks. Quantitative data indicated significant improvement of both fluency and accuracy in the experimental group and the effect sizes were large which indicates a significant instructional improvement. Respondents of surveys expressed positive expectations of ChatGPT, having more confidence, less anxiety, and being motivated. The active idea generation, vocabulary development, and self-editing promoted by the integration of ChatGPT. The results open the perspective of the AI chatbots as a supportive tool to traditional teaching in case of ethical application and pedagogical instruction.

Keywords

academic writing artificial intelligence ChatGPT EFL learners smart learning tools

Get full access to this article

View all access options for this article.

References

Barrot

(2023) Using ChatGPT for second language writing: pitfalls and potentials. Assessing Writing 57: 100745. https://doi.org/10.1016/j.asw.2023.100745.

Bonner

Lege

Frazier

(2023) Large language model-based artificial intelligence in the language classroom: practical ideas for teaching. Teaching English with Technology 23(1): 23–41. https://doi.org/10.56297/BKAM1691/WIEO1749.

Fitria

(2023) Artificial intelligence (AI) technology in OpenAI ChatGPT application: a review of ChatGPT in writing English essays. ELT Forum: Journal of English Language Teaching 12(1): 44–58. https://doi.org/10.15294/elt.v12i1.64069.

Gayed

Carlon

MKJ

Oriola

, et al. (2022) Exploring an AI-based writing assistant’s impact on English language learners. Computers and Education: Artificial Intelligence 3: 100055. https://doi.org/10.1016/j.caeai.2022.100055.

Guo

Wang

Chu

SKW

(2022) Using chatbots to scaffold EFL students’ argumentative writing. Assessing Writing 54: 100666. https://doi.org/10.1016/j.asw.2022.100666.

Hezam

Al-Mekhlafy

Mahyoub

(2024) Perceptions of Yemeni EFL students on the use of AI tools: awareness, frequency, and preferred applications. International Journal of Education and Literacy Studies 6(4): 47–56. https://doi.org/10.32996/ijels.2024.6.4.7.

Imran

Almusharraf

(2023) Analyzing the role of ChatGPT as a writing assistant at higher education level: a systematic review of the literature. Contemporary Educational Technology 15(4): e464. https://doi.org/10.30935/cedtech/13605.

Kasneci

Seßler

Küchemann

, et al. (2023) ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences 103: 102274. https://doi.org/10.1016/j.lindif.2023.102274.

Kohnke

Moorhouse

Zou

(2023) ChatGPT for language teaching and learning. RELC Journal 54(2): 537–550. https://doi.org/10.1177/00336882231162868.

10.

Lingard

(2023) Writing with ChatGPT: an illustration of its capacity, limitations, and implications for academic writers. Perspectives on Medical Education 12(1): 261–270. https://doi.org/10.5334/pme.1072.

11.

Marzuki

Widiati

Rusdin

, et al. (2023) The impact of AI writing tools on the content and organization of students’ writing: EFL teachers’ perspective. Cogent Education 10(2): 2236469. https://doi.org/10.1080/2331186X.2023.2236469.

12.

Mizumoto

Eguchi

(2023) Exploring the potential of using an AI language model for automated essay scoring. Research Methods in Applied Linguistics 2(2): 100050. https://doi.org/10.1016/j.rmal.2023.100050.

13.

Rad

Alipour

Jafarpour

(2023) Using artificial intelligence to foster students’ writing feedback literacy, engagement, and outcome: a case of wordtune application. Interactive Learning Environments 32(9): 5020–5040. https://doi.org/10.1080/10494820.2023.2208170.

14.

Lin

Lai

(2023) Collaborating with ChatGPT in argumentative writing classrooms. Assessing Writing 57: 100752. https://doi.org/10.1016/j.asw.2023.100752.

15.

Wang

(2025) A study on the efficacy of ChatGPT-4 in enhancing students’ English communication skills. Sage Open 15(1). https://doi.org/10.1177/21582440241310644.

16.

Zhai

(2023) ChatGPT for next generation science learning. XRDS: crossroads. The ACM Magazine for Students 29(3): 42–46. https://doi.org/10.1145/3589649.