Advancing language assessment for teaching and learning in the era of the artificial intelligence (AI) revolution: Promises and challenges

Al-Ghezi R. Voskoboinik K. Getman Y. Von Zansen A. Kallio H. Kurimo M. Huhta A. Hildén R. (2023). Automatic speaking assessment of spontaneous L2 Finnish and Swedish. Language Assessment Quarterly, 20(4-5), 421–444.

Bachman L. Adrian P. (2022). Language assessment in practice: Developing language assessments and justifying their use in the real world. Oxford University Press.

Bolender B. Foster C. Vispoel S. (2023). The criticality of implementing principled design when using AI technologies in test development. Language Assessment Quarterly, 20(4–5), 512–519. https://doi.org/10.1080/15434303.2023.2288266

Boulton A. (2017). Data–driven learning and language pedagogy. In Thorne S. May S. (Eds.), Language, education and technology: Encyclopedia of language and education (pp. 181–192). Springer. https://doi.org/10.1007/978-3-319-02237-6_15

Briggs D. C. (2024). Strive for measurement, set new standards, and try not to be evil. Journal of Educational and Behavioral Statistics, 49(5), 694–701. https://doi.org/10.3102/10769986241238479

Chapelle C. A. (2001). Computer applications in second language acquisition. Cambridge University Press.

Chapelle C. A. (2012). Validity argument for language assessment: The framework is simple…. Language Testing, 29(1), 19–27.

Chapelle C. A. Voss E. (Eds.). (2021). Validity argument in language testing: Case studies of validation research. Cambridge University Press.

Chen Y. Jensen S. Albert L. J. Gupta S. Lee T. (2023). Artificial intelligence (AI) student assistants in the classroom: Designing chatbots to support student success. Information Systems Frontiers, 25, 161–182. https://doi.org/10.1007/s10796-022-10291-4

Choi I. Zu J. (2025). Generating language assessment content free from representational harms. Language Testing, 42(4). https://doi.org/10.1177/02655322251349560

Ferrara S. Qunbar S. (2022). Validity arguments for AI-based automated scores: Essay scoring as an illustration. Journal of Educational Measurement, 59(3), 288–313. https://doi.org/10.1111/jedm.12333

Galaczi E. Luckin R. (2024). Generative AI and language education: Opportunities, challenges and the need for critical perspectives. Cambridge Papers in English Language Education. Cambridge University Press.

Galaczi E. Taylor L. (2018). Interactional competence: Conceptualisations, operationalisations, and outstanding questions. Language Assessment Quarterly, 15, 219–236.

Gallegos I. O. Rossi R. A. Barrow J. Tanjim M. M. Kim S. Dernoncourt F. Yu T. Zhang R. Ahmed N. K . (2024). Bias and fairness in large language models: A survey. Computational Linguistics, 50(3), 1097–1179. https://doi.org/10.48550/arXiv.2309.00770

Godwin-Jones R. (2022). Partnering with AI: Intelligent writing assistance and instructed language learning. Language Learning & Technology, 26(2), 5–24. https://doi.org/10.10125/73474

Guo S. Wang Y. Yu J. Wu X. Ayik B. Watts F. Latif E. Liu L. Liu N. Zhai X. (2025). Artificial intelligence bias on English language learners in automatic scoring. In Proceedings of the International Conference on AI in Education (pp. 1–12). https://doi.org/10.48550/arXiv.2505.10643

Hannah L. Jang E. E. Lee M.-H. Russell B. (2025). Investigating construct representativeness and linguistic equity of automated oral reading fluency assessment with prosody. Language Testing, 42(4). https://doi.org/10.1177/02655322251348956

Hannah L. Jang E. E. Shah M. Gupta V. (2023). Validity arguments for automated essay scoring of young students’ writing traits. Language Assessment Quarterly, 20(4–5), 399–420. https://doi.org/10.1080/15434303.2023.2288253

Jin Y. Fan J. (2023). Testtaker engagement in AI technology-mediated language assessment. Language Assessment Quarterly, 20(4–5), 488–500. https://doi.org/10.1080/15434303.2023.2291731

Khabbazbashi N. Galaczi E. Allen H. Lopes S. Nakatsuhara F. Halley K. (2023). Exploring the impact of generative AI on language education: Insights from teachers. Cambridge Papers in English Language Education. Cambridge University Press.

Ockey G. J. Chukharev-Hudilainen E. Hirch R. R. (2023). Assessing interactional competence: ICE versus a human partner. Language Assessment Quarterly, 20(4–5), 377–398. https://doi.org/10.1080/15434303.2023.2237486

O’Sullivan B. (2023). Reflections on the application and validation of technology in language testing. Language Assessment Quarterly, 20(4–5), 501–511. https://doi.org/10.1080/15434303.2023.2291486

Plough I. Banerjee J. Iwashita N. (2018). Interactional competence: Genie out of the bottle. Language Testing, 35(3), 427–445. https://doi.org/10.1177/0265532218772325

Purpura J. E. (2025). Learning-oriented language assessment. In Kunnan A. J. (Ed.), The concise companion to language assessment (pp. 22–41). John Wiley.

Runge A. Goodwin S. Attali Y. Poe M. Mulcaire P. Lo K.-L. LaFlair G. T. (2025). A multi-stage interactive writing task for the assessment of English language writing proficiency. Language Testing, 42(4). https://doi.org/10.1177/02655322251349908

Sawaki Y. (2022). Computer-based testing. In Fulcher G. Harding L. (Eds.), The Routledge handbook of language testing (2nd ed., pp. 530–544). Routledge.

Sawaki Y. Ishii Y. Yamada H. Tokunaga T. (2025). Examining the consistency of instructor vs. large language model ratings on summary content: Toward checklist-based feedback provision with second language writers. Language Testing, 42(4). https://doi.org/10.1177/02655322251349217

Shermis M. D. Burstein J. (Eds.). (2013). Handbook of automated essay evaluation: Current applications and future directions. Routledge.

Suzuki S. Takatsu H. Matsuura R. Koyama M. Saeki M. Matsuyama Y. (2025). Feedforwarding diagnostic language assessment: Artificial intelligence-driven weakness identification and contextualised feedback for second language speaking. Language Testing, 42(4). https://doi.org/10.1177/02655322251348725

Vaswani A. Shazeer N. M. Parmar N. Uszkoreit J. Jones L. Gomez A. N. Kaiser L. Polosukhin I. (2017). Attention is all you need. 31st International Conference on Neural Information Processing Systems. https://doi.org/10.48550/arXiv.1706.03762

von Davier A. A. Burstein J . (2024). AI in the assessment ecosystem: A human-centered AI perspective. In Ilic P. Casebourne I. Wegerif R. (Eds.), Intelligent systems reference library. Artificial intelligence in education: The intersection of technology and pedagogy (Vol. 261, pp. 93–109). Springer. https://doi.org/10.1007/978-3-031-71232-6_6

Voskoboinik E. von Zansen A. Phan N. Getman Y. Grósz T. Kurimo M. (2025). Enhancing second language speech assessment: Integrating large language models for Finnish and Finland Swedish proficiency scoring. Language Testing, 42(4). https://doi.org/10.1177/02655322251351648

Voss E. (2021). The role of technology in learning-oriented assessment. In Gebril A. (Ed.) Learning, oriented language assessment: Putting theory into practice (pp. 207–224). Routledge.

Voss E. (2025). Comparison of traditional machine learning and neural network approaches for automated scoring of second language English essays. Language Testing, 42(4). https://doi.org/10.1177/02655322251348959

Warschauer M. Grimes D. (2007). Audience, authorship, and artifact: The emergent semiotics of Web 2.0. Annual Review of Applied Linguistics 27, 1–27.

Warschauer M. Xu Y. (2024). Artificial intelligence for language learning: Entering a new era. Language Learning & Technology, 28(2), 1–4. https://hdl.handle.net/10125/73569

Xi X. (2023). Advancing language assessment with AI and ML–learning into AI is inevitable, but can theory keep up? Language Assessment Quarterly, 20(4–5), 357–376.

Zhang D. Hoang T. Pan S. Hu Y. Xing Z. Staples M. Xu X. Lu Q. Quigley A. (2023). Test-takers have a say: Understanding the implications of the use of AI in language tests (arXiv:2307.09885). https://doi.org/10.48550/arXiv.2307.09885