This study addresses the increasing role of artificial intelligence in higher education by developing a self-assessment instrument for artificial intelligence literacy among university students in Vietnam. Three primary dimensions of artificial intelligence literacy were identified: understanding, application, and ethics and responsibility. The scale was tested using data collected from 843 university students. Exploratory factor analysis was conducted on a sample of 420 students to explore the structure of the scale, and confirmatory factor analysis was carried out on a separate sample of 423 students to validate the tool. The analysis results showed that the final questionnaire demonstrated high reliability and validity; it comprised 26 items and the Cronbach's alpha coefficients for each dimension exceeded .886. This instrument not only supports the evaluation of students’ artificial intelligence literacy but also aids universities in designing appropriate training programs, thereby enhancing students’ awareness and ability to apply artificial intelligence in a creative and responsible manner.
AounJE (2017) Robot-Proof: Higher Education in the Age of Artificial Intelligence. Cambridge, MA and London, UK: MIT Press.
2.
BeetsBNewmanTPHowellE, et al. (2023) Surveying public perceptions of artificial intelligence in health care in the United States: Systematic review. Journal of Medical Internet Research25: Article e40337.
BollenKA (1989) Structural Equations with Latent Variables. New York: Wiley.
5.
BrownTA (2006) Confirmatory Factor Analysis for Applied Research. New York and London: Guilford Press.
6.
BrowneMWCudeckR (1992) Alternative ways of assessing model fit. Sociological Methods and Research21(2): 230–258.
7.
Buitrago-CiroJSamokishynMMoylanR, et al. (2025) Bridging the AI gap: Comparative analysis of AI integration, education, and outreach in academic libraries. IFLA Journal 51(3): 682–702.
8.
CarolusAKochMJStrakaS, et al. (2023) MAILS—Meta AI Literacy Scale: Development and testing of an AI literacy questionnaire based on well-founded competency models and psychological change- and meta-competencies. Computers in Human Behavior: Artificial Humans1(2): Article 100014.
9.
ÇelebiCYilmazFDemirÜ, et al. (2023) Artificial intelligence literacy : An adaptation study. Instructional Technology and Lifelong Learning4(2): 291–306.
10.
ChiuTKFAhmadZÇobanM (2025) Development and validation of teacher artificial intelligence (AI) competence self-efficacy (TAICS) scale. Education and Information Technologies 30: 6667–6685.
11.
ChungKKimSJangY, et al. (2025) Developing an AI literacy diagnostic tool for elementary school students. Education and Information Technologies30: 1013–1044.
CroninI (2024) Understanding Generative AI Business Applications: A Guide to Technical Principles and Real-World Applications. Apress.
14.
DeepaN (2024) Artificial intelligence and social implications: A sociological analysis. Recent Trends in Management and Commerce5(2): 78–82. Available at: https://restpublisher.com/wp-content/uploads/2024/07/17.-Artificial-Intelligence-and-Social-Implications-A-Sociological-Analysis-1.pdf.
15.
DollWJXiaW (1996) Confirmatory factor analysis of the end-user computing satisfaction instrument: A replication. Journal of Organizational and End User Computing9(2): 24–31.
16.
GhoshSSinghA (2020) The scope of artificial intelligence in mankind: A detailed review. Journal of Physics: Conference Series1531: Article 012045.
17.
GongXZhaoLTangRH, et al. (2019) AI education system for primary and secondary schools. In: 2019 ASEE annual conference and exposition: Curriculum and Assessment III, Tampa, Florida, USA, 15–19 June 2019. Washington, DC: American Society for Engineering Education.https://doi.org/10.18260/1-2--32050.
18.
HairJFBlackWCBabinBJ, et al. (2010) Multivariate Data Analysis. 7th ed.Upper Saddle River, NJ: Pearson Prentice Hall.
19.
HairJFBlackWCBabinBJ, et al. (2018) Multivariate Data Analysis.. 7th ed.Andover, Hampshire: Cengage Learning Australia.
20.
HornbergerMBewersdorffANerdelC (2023) What do university students know about artificial intelligence? Development and validation of an AI literacy test. Computers and Education: Artificial Intelligence5: Article 100165.
21.
HossainZBiswasSKhanG (2025) AI literacy of library and information science students: A study of Bangladesh, India and Pakistan. Journal of Librarianship and Information Science. Epub ahead of print 2 January 2025. DOI: 10.1177/09610006241309323.
22.
HuLTBentlerPM (1999) Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling6(1): 1–55.
JärveläSNguyenAHadwinA (2023) Human and artificial intelligence collaboration for socially shared regulation in learning. British Journal of Educational Technology54(5): 1057–1076.
25.
KamalovFSantandreu CalongeDGurribI (2023) New era of artificial intelligence in education: Towards a sustainable multifaceted revolution. Sustainability15(16): Article 12451.
26.
KimSWLeeY (2022) The artificial intelligence literacy scale for middle school students. Journal of the Korea Society of Computer and Information27(3): 225–238.
27.
LaupichlerMCAsterAHaverkampN, et al. (2023) Development of the “Scale for the assessment of non-experts’ AI literacy”—An exploratory factor analysis.Computers in Human Behavior Reports12: Article 100338.
28.
LeeIAliSZhangH, et al. (2021) Developing middle school students’ AI literacy. In: SIGCSE ’21: Proceedings of the 52nd ACM technical symposium on computer science education, USA, 13–20 March 2021, pp. 191–197. Association for Computing Machinery.
29.
LongDBluntTMagerkoB (2021) Co-designing AI literacy exhibits for informal learning spaces. Proceedings of the ACM on Human–Computer Interaction5(CSCW2): Article 293.
30.
MacCallumRCHongS (1997) Power analysis in covariance structure modeling using GFI and AGFI. Multivariate Behavioral Research32(2): 193–210.
31.
MillsKRuizPLeeKW, et al. (2024) AI Literacy: A Framework to Understand, Evaluate, and Use Emerging Technology. Washington, DC: Digital Promise.
32.
Morales-GarcíaWCSairitupa-SanchezLZMorales-GarcíaSB, et al. (2024) Adaptation and psychometric properties of a brief version of the general self-efficacy scale for use with artificial intelligence (GSE-6AI) among university students. Frontiers in Education9: Article 1293437.
33.
NgDTKLeungJKLChuSKW, et al. (2021) Conceptualizing AI literacy: An exploratory review. Computers and Education: Artificial Intelligence2: Article 100041.
34.
NgDTKWuWLeungJKL, et al. (2024) Design and validation of the AI literacy questionnaire: The affective, behavioural, cognitive and ethical approach. British Journal of Educational Technology55(3): 1082–1104.
35.
NwakanmaCIAhakonyeLACNjokuJN, et al. (2023) Explainable artificial intelligence (XAI) for intrusion detection and mitigation in intelligent connected vehicles: A review. Applied Sciences13(3): Article 1252.
36.
OwanVJAbangKBIdikaDO, et al. (2023) Exploring the potential of artificial intelligence tools in educational measurement and assessment. Eurasia Journal of Mathematics, Science and Technology Education19(8): Article em2307.
37.
PallantJ (2007) SPSS Survival Manual: A Step by Step Guide to Data Analysis Using SPSS for Windows (Version 15).3rd ed.Maidenhead: Open University Press.
38.
PercMOzerMHojnikJ (2019) Social and juristic challenges of artificial intelligence. Palgrave Communications5(1): Article 61.
39.
PinskiMBenlianA (2023AI literacy – towards measuring human competency in artificial intelligence.56th Hawaii International Conference on System Sciences (HICSS), Lahaina, USA, January 2023. Honolulu, HI: University of Hawai‘i at Mānoa. https://doi.org/10.24251/HICSS.2023.021.
40.
RyabkoTVGurtovVAStepusIS (2022) Analysis of artificial intelligence training indicators according to the results of Russian universities monitoring. Vysshee Obrazovanie v Rossii—Higher Education in Russia31(7): 9–24.
41.
SouthworthJMigliaccioKGloverJ, et al. (2023) Developing a model for AI across the curriculum: Transforming the higher education landscape via innovation in AI literacy. Computers and Education: Artificial Intelligence4: Article 100127.
42.
StreinerDL (1994) Figuring out factors: The use and misuse of factor analysis. Canadian Journal of Psychiatry39(3): 135–140.
43.
TenórioKRomeikeR (2023) AI competencies for non-computer science students in undergraduate education: Towards a competency framework. In: Koli Calling ’23: Proceedings of the 23rd Koli Calling international conference on computing education research, Koli, Finland, 13–18 November 2023, Article 6. Association for Computing Machinery.
44.
TomczykPBrüggemannPPetrescuM (2024) Are AI tools better than traditional tools in literature searching? Evidence from e-commerce research. Journal of Librarianship and Information Science. Epub ahead of print 15 November 2024. DOI: 10.1177/09610006241295802
45.
UNESCO (2024a) AI Literacy Framework for Students. Paris: UNESCO.
46.
UNESCO (2024b) AI Literacy Framework for Teachers. Paris: UNESCO.
Vázquez-ParraJCHenao-RodríguezCLis-GutiérrezJP, et al. (2024) Importance of university students’ perception of adoption and training in artificial intelligence tools. Societies14(8): Article 41.
49.
WangBRauPLPYuanT (2022) Measuring user competence in using artificial intelligence: Validity and reliability of artificial intelligence literacy scale. Behaviour and Information Technology42(9): 1324–1337.
50.
WangNLesterJ (2023) K–12 education in the age of AI: A call to action for K–12 AI literacy. International Journal of Artificial Intelligence in Education33(2): 228–232.
51.
WangSSunZChenY (2023) Effects of higher education institutes’ artificial intelligence capability on students’ self-efficacy, creativity and learning performance. Education and Information Technologies28(5): 4919–4939.
52.
YiY (2021) Establishing the concept of AI literacy: Focusing on competence and purpose. JAHR–European Journal of Bioethics12(2): 353–368.
53.
YuXMaNZhengL, et al. (2023) Developments and applications of artificial intelligence in music education. Technologies11(2): Article 42.
