The development and validation of the artificial intelligence literacy scale for middle school English teachers

Abstract

As artificial intelligence (AI) becomes increasingly embedded in education, AI literacy has emerged as a critical competency for teachers across disciplines. However, existing research and assessment tools largely focus on STEM (science, technology, engineering and mathematics) fields, with limited attention given to AI literacy within language education. To address this gap, the present study aimed to develop and validate an AI literacy scale specifically designed for middle school English teachers in China. The scale is based on a four-dimensional framework comprising Awareness, Use, Evaluation, and Ethics. Using sequential design, item analysis and exploratory factor analysis were conducted with a sample of 700 teachers, followed by confirmatory factor analysis with an independent sample of 823 teachers, resulting in a final instrument comprising 24 items across four dimensions. The final instrument is structured around four dimensions: awareness, use, evaluation, and ethics. In addition, the scale demonstrated strong psychometric properties, including satisfactory reliability, construct validity, and criterion-related validity. Furthermore, measurement invariance was established across gender, age, and educational level, indicating the robustness of the scale across key demographic groups. The study offers a validated, context-specific tool to inform professional development and educational policy, enhancing teachers’ preparedness for AI-integrated instruction.