Exploring researchers’ artificial intelligence (AI) literacy: The mediating role of digital literacy and data literacy between 21st century skills and AI literacy
Restricted accessResearch articleFirst published online 2025
Exploring researchers’ artificial intelligence (AI) literacy: The mediating role of digital literacy and data literacy between 21st century skills and AI literacy
Many researchers have started using artificial intelligence (AI) tools in the different parts of their scientific research processes. A high level of AI literacy is required to utilize AI tools effectively. AI literacy also includes many cognitive and technical skills. These pre-requisite skills can impact researchers’ AI usage competencies. In this context, the current study aimed to investigate the determinants of researchers’ AI literacy from the demographic variables and twenty-first century skills. For this purpose, a model was created with 24 hypotheses and tested using data collected by 708 researchers from various universities in Türkiye. Non-experts AI literacy, digital literacy, data literacy, and computational thinking scales, and demographic information form were used as data collection tools. Structural Equation Modelling (SEM) was used to reveal the relationship among the variables. The results revealed that digital literacy and data literacy skills are the strongest predictors of AI literacy. In addition, digital literacy and data literacy have mediating roles between the some 21st skills and AI literacy. There are also some demographic variables such as English language level and frequency of AI use, which are the significant predictors of AI literacy.
AltmäeSSola-LeyvaASalumetsA (2023) Artificial intelligence in scientific writing: A friend or a foe?Reproductive BioMedicine Online47(1): 3–9.
2.
ArslantasTKGulA (2022) Digital literacy skills of university students with visual impairment: A mixed-methods analysis. Education and Information Technologies27(4): 5605–5625.
3.
AyanwaleMAAdelanaOPMolefiRR, et al. (2024) Examining artificial intelligence literacy among pre-service teachers for future classrooms. Computers and Education Open6: 100179.
4.
BenbowRJLeeCHoraMT (2021) Exploring college faculty development in 21st-century skill instruction: An analysis of teaching-focused personal networks. Journal of Further and Higher Education45(6): 818–835.
5.
BringulaR (2023) What do academics have to say about ChatGPT? A text mining analytics on the discussions regarding ChatGPT on research writing. AI and Ethics 5: 371–383. https://doi.org/10.1007/s43681-023-00354-w.
6.
CarolusAKochMJStrakaS, et al. (2023) MAILS - Meta AI literacy scale: Development and testing of an AI literacy questionnaire based on well-founded competency models and psychological change- and meta-competencies. Computers in Human Behavior: Artificial Humans1(2): 100014.
7.
CastroMSBahliBFerreiraJJ, et al. (2023) Comparing single-item and multi-item trust scales: Insights for assessing trust in project leaders. Behavioral Sciences13(9): 1–14. https://doi.org/10.3390/bs13090786.
8.
CelikI (2023) Exploring the determinants of artificial intelligence (AI) literacy: Digital divide, computational thinking, cognitive absorption. Telematics and Informatics83: 102026.
9.
CetindamarDKittoKWuM, et al. (2024) Explicating AI literacy of employees at digital workplaces. IEEE Transactions on Engineering Management71: 810–823.
10.
ÇevikYD (2015) Predicting college students’ online information searching strategies based on epistemological, motivational, decision-related, and demographic variables. Computers and Education90: 54–63.
11.
ChenKTC (2020) University EFL students’ use of online English information searching strategy. Iranian Journal of Language Teaching Research8(1): 111–127.
12.
ChiuTKFAhmadZIsmailovM, et al. (2024a) What are artificial intelligence literacy and competency? A comprehensive framework to support them. Computers and Education Open6: 1–9.
13.
ChiuTKFChenYYauKW, et al. (2024b) Developing and validating measures for AI literacy tests: From self-reported to objective measures. Computers and Education: Artificial Intelligence7: 1–10. https://doi.org/10.1016/j.caeai.2024.100282.
14.
ChuriPJoshiSElhosenyM, et al. (2022) Artificial Intelligence in Higher Education: A Practical Approach. Florida: CRC Press.
15.
DadhichMBhaumikA (2023) Demystification of generative artificial intelligence (AI) literacy, algorithmic thinking, cognitive divide, pedagogical knowledge: A comprehensive model. In: 3rd IEEE International Conference on ICT in Business Industry and Government, ICTBIG 2023. https://doi.org/10.1109/ICTBIG59752.2023.10456172
16.
DalalahDDalalahOMA (2023) The false positives and false negatives of generative AI detection tools in education and academic research: The case of ChatGPT. International Journal of Management Education21(2): 100822.
17.
DarwinRusdinDMukminatienN, et al. (2024) Critical thinking in the AI era: An exploration of EFL students’ perceptions, benefits, and limitations. Cogent Education11(1): 1–18. https://doi.org/10.1080/2331186X.2023.2290342.
18.
DergaaIChamariKZmijewskiP, et al. (2023) From human writing to artificial intelligence generated text: Examining the prospects and potential threats of ChatGPT in academic writing. Biology of Sport40(2): 615–622.
FarrokhniaMBanihashemSKNorooziO, et al. (2023) A SWOT analysis of ChatGPT: Implications for educational practice and research. Innovations in Education and Teaching International61(3): 460–474.
21.
FieldA (2009) Discovering Statistics Using SPSS (3rd ed.). London: Sage Publications Inc.
22.
FuYLomasEInskipC (2021) Library log analysis and its implications for studying online information seeking behavior of cultural groups. Journal of Academic Librarianship47(5): 102421.
23.
GaoZLiLMaS, et al. (2023) Examining the potential of ChatGPT on biomedical information retrieval: Fact-checking drug-disease associations. Annals of Biomedical Engineering52(8): 1919–1927.
24.
GudeV (2023) Factors influencing ChatGPT adoption for product research and information retrieval. Journal of Computer Information Systems 65(2): 222–231. https://doi.org/10.1080/08874417.2023.2280918.
25.
HabibSVogelTAnliX, et al. (2024) How does generative artificial intelligence impact student creativity?Journal of Creativity34(1): 1–7. https://doi.org/10.1016/j.yjoc.2023.100072.
26.
HairJFHultGTMRingleCM, et al. (2021) Partial Least Squares Structural Equation Modeling (PLS-SEM) Using R. Cham: Springer. https://doi.org/10.1007/978-3-030-80519-7.
27.
HornbergerMBewersdorffANerdelC (2023) What do university students know about artificial intelligence? Development and validation of an AI literacy test. Computers and Education: Artificial Intelligence5: 100165.
28.
HuL (2024) Programming and 21st century skill development in K-12 schools: A multidimensional meta-analysis. Journal of Computer Assisted Learning40(2): 610–636.
29.
JoksimovicSIfenthalerDMarroneR, et al. (2023) Opportunities of artificial intelligence for supporting complex problem-solving: Findings from a scoping review. Computers and Education: Artificial Intelligence4: 100138.
KesiciA (2022) The effect of digital literacy on creative thinking disposition: The mediating role of lifelong learning disposition. Journal of Learning and Teaching in Digital Age7(2): 260–273.
32.
KimJHongLEvansS, et al. (2023) Development and validation of a data literacy assessment scale. Proceedings of the Association for Information Science and Technology60(1): 620–624.
33.
KimMAdlofL (2023) Adapting to the future: ChatGPT as a means for supporting constructivist learning environments. TechTrends68: 37–46.
KocakOCobanMAydinA, et al. (2021) The mediating role of critical thinking and cooperativity in the 21st century skills of higher education students. Thinking Skills and Creativity42(January): 100967.
36.
KongSCCheungMYWTsangO (2024) Developing an artificial intelligence literacy framework: Evaluation of a literacy course for senior secondary students using a project-based learning approach. Computers and Education: Artificial Intelligence6: 1–11. https://doi.org/10.1016/j.caeai.2024.100214.
37.
KongSCCheungMYWZhangG (2023) Evaluating an artificial intelligence literacy programme for developing university students’ conceptual understanding, literacy, empowerment and ethical awareness. Educational Technology and Society26(1): 16–30.
38.
KorkmazÖÇakirRÖzdenMY (2017) A validity and reliability study of the computational thinking scales (CTS). Computers in Human Behavior72: 558–569.
39.
KoseBKocakO (2024) The predictors of academics’ online information searching strategies: A structural model integrating cognitive absorption and digital literacy. Library and Information Science Research46(2): 101299.
40.
LaupichlerMCAsterAHaverkampN, et al. (2023) Development of the “Scale for the assessment of non-experts’ AI literacy” – An exploratory factor analysis. Computers in Human Behavior Reports12: 1–10. https://doi.org/10.1016/j.chbr.2023.100338.
41.
LaupichlerMCAsterASchirchJ, et al. (2022) Artificial intelligence literacy in higher and adult education: A scoping literature review. Computers and Education: Artificial Intelligence3(September): 100101.
42.
LeeSParkG (2024) Development and validation of ChatGPT literacy scale. Current Psychology43(21): 18992–19004.
43.
LeeVChengDYYLitKKD, et al. (2025) Active ageing in the digital era: The role of new technologies in promoting the wellbeing of older people in Hong Kong. Asia Pacific Journal of Social Work and Development: 1–20. https://doi.org/10.1080/29949769.2025.2457363.
44.
LiYWangYLeeY, et al. (2023) Teaching data science through storytelling: Improving undergraduate data literacy. Thinking Skills and Creativity48: 1–15. https://doi.org/10.1016/j.tsc.2023.101311.
45.
LivberberTAyvazS (2023) The impact of artificial intelligence in academia: Views of Turkish academics on ChatGPT. Heliyon9(9): e19688.
46.
LongDMagerkoB (2020) What is AI literacy? Competencies and design considerations. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–16. https://doi.org/10.1145/3313831.3376727
MirtaBEnriqueMCLiliamA (2024) The ChatGPT: Revolutionizing research with AI. Anais Da Academia Brasileira de Ciencias96(3): 1–16.
49.
Naamati-SchneiderLAltD (2024) Beyond digital literacy: The era of AI-powered assistants and evolving user skills. Education and Information Technologies 29: 21263–21293. https://doi.org/10.1007/s10639-024-12694-z.
50.
NgDTKLeungJKLChuKWS, et al. (2021a) AI Literacy: Definition, teaching, evaluation and ethical issues. Proceedings of the Association for Information Science and Technology58(1): 504–509. https://doi.org/10.1002/pra2.487
51.
NgDTKLeungJKLChuSKW, et al. (2021b) Conceptualizing AI literacy: An exploratory review. Computers and Education: Artificial Intelligence2: 100041. https://doi.org/10.1016/j.caeai.2021.100041.
52.
NgDTKSuJChuSKW (2024a) Fostering secondary school students’ AI literacy through making AI-driven recycling bins. Education and Information Technologies29: 9715–9746. https://doi.org/10.1007/s10639-023-12183-9.
53.
NgDTKWuWLeungJKL, et al. (2024b) Design and validation of the AI literacy questionnaire: The affective, behavioural, cognitive and ethical approach. British Journal of Educational Technology55(3): 1082–1104.
54.
NgW (2012) Can we teach digital natives digital literacy?Computers and Education59(3): 1065–1078.
ÖzSÖzdemirA (2022) Validity and reliability study on the development of data literacy scale for educators. International Journal of Contemporary Educational Research9(3): 649–661.
57.
PapyshevG (2024) Situated usage of generative AI in policy education: Implications for teaching, learning, and research. Journal of Asian Public Policy: 1–18. https://doi.org/10.1080/17516234.2024.2370716.
58.
PaşalıY (2023) Measuring digital literacy: Development and validation of an instrument for teachers. Master Dissertation. Middle East Technical University.
59.
PavlikJV (2023) Collaborating with ChatGPT: Considering the implications of generative artificial intelligence for journalism and media education. Journalism and Mass Communication Educator78(1): 84–93.
60.
RahmanMMWatanobeY (2023) ChatGPT for education and research: Opportunities, threats, and strategies. Applied Sciences13(9): 1–21. https://doi.org/10.3390/app13095783.
61.
RayPP (2023) ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet of Things and Cyber-Physical Systems3: 121–154.
62.
Ruiz-RojasLISalvador-UllauriLAcosta-VargasP (2024) Collaborative working and critical thinking: Adoption of generative artificial intelligence tools in higher education. Sustainability16(13): 1–23. https://doi.org/10.3390/su16135367.
63.
StolpeKHallstromJ (2024) Artificial intelligence literacy for technology education. Computers and Education Open6: 100159.
64.
SuJYangW (2023) Artificial intelligence (AI) literacy in early childhood education: An intervention study in Hong Kong. Interactive Learning Environments 32(9): 5494–5508. https://doi.org/10.1080/10494820.2023.2217864.
TangTVezzaniVErikssonV (2020) Developing critical thinking, collective creativity skills and problem solving through playful design jams. Thinking Skills and Creativity37(May): 100696.
67.
TiborK (2024) From data literacy to artificial intelligence literacy: Background and approaches. Central European Library and Information Science Review 2(1): 41–48. https://doi.org/10.3311/celisr.38042.
Toker GokceADeveci TopalAKolburan GeçerA, et al. (2024) Investigating the level of artificial intelligence literacy of university students using decision trees. Education and Information Technologies 30: 6765–6784. https://doi.org/10.1007/s10639-024-13081-4.
70.
TsvetkovaMSKiryukhinVM (2021) Algorithmic thinking and new digital literacy. Olympiads in Informatics15: 105–118.
71.
UrbanMDěchtěrenkoFLukavskýJ, et al. (2024) ChatGPT improves creative problem-solving performance in university students: An experimental study. Computers and Education215: 1–15. https://doi.org/10.1016/j.compedu.2024.105031.
72.
van LaarEvan DeursenAJAMvan DijkJAGM, et al. (2020) Determinants of 21st-century skills and 21st-century digital skills for workers: A systematic literature review. SAGE Open10:1–14. https://doi.org/10.1177/2158244019900176.
73.
WalterY (2024) Embracing the future of Artificial Intelligence in the classroom: the relevance of AI literacy, prompt engineering, and critical thinking in modern education. International Journal of Educational Technology in Higher Education21(1): 1–29. https://doi.org/10.1186/s41239-024-00448-3.
74.
WangBRauPLPYuanT (2023) Measuring user competence in using artificial intelligence: Validity and reliability of artificial intelligence literacy scale. Behaviour and Information Technology42(9): 1324–1337.
75.
WangD (2024) AI Tools can help universities maximaze research impacts. Nature630: 794.
76.
WijayaTTYuQCaoY, et al. (2024) Latent profile analysis of AI literacy and trust in mathematics teachers and their relations with AI dependency and 21st-century skills. Behavioral Sciences14(11): 1008.
77.
WingJM (2006) Computational thinking. Communications of the ACM49(3): 33–35.
78.
WitteVSchweringAFrischemeierD (2025) Strengthening data literacy in K-12 education: A scoping review. Education Sciences15(1): 25.
79.
YeşilyurtEVezneR (2023) Digital literacy, technological literacy, and internet literacy as predictors of attitude toward applying computer-supported education. Education and Information Technologies28: 9885–9911.
80.
YiY (2021) Establishing the concept of AI literacy: Focusing on competence and purpose. Jahr12(2): 353–368.
81.
YılmazFGKYılmazR (2023) Adaptation of artificial intelligence literacy scale into Turkish. e-Kafkas Journal of Educational Research5(2): 172–190.
82.
ZhaoLWuXLuoH (2022) Developing AI literacy for primary and middle school teachers in China: Based on a structural equation modeling analysis. Sustainability14(21): 1–16.
83.
ZouXSuPLiL, et al. (2023) AI-generated content tools and students’ critical thinking: Insights from a Chinese university. IFLA Journal 50(2): 228–241. https://doi.org/10.1177/03400352231214963.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
