This study aims to develop and validate the Information, Media, and Technology Skills Self-Efficacy Scale (IMTS-SES) based on the P21 framework. The data were collected in a three-stage process in Türkiye/Amasya, specifically from schools affiliated with the Ministry of National Education (MoNE). The scale was first distributed to 481 students to perform exploratory factor analysis. Secondly, the emerged model was tested through confirmatory factor analysis with the data from a different group of 230 students. Finally, the data were collected from 41 students for the test–retest reliability and the analysis demonstrated the stability of the scale. The validated scale consists of three factors and 17 items: technology literacy skill self-efficacy, information literacy skill self-efficacy, and media literacy skill self-efficacy. The required psychometric analyses indicated that the developed scale is a valid and reliable instrument, capable of measuring information, media, and technology skills self-efficacy of the middle school students according to the P21 framework.
AjzenI (2002) Perceived behavioral control, self-efficacy, locus of control, and the theory of planned behavior 1. Journal of Applied Social Psychology32(4): 665–683.
2.
AnagünŞSAtalayNKiliçZ, et al. (2016) Developing 21st century skills competence perceptions scale for prospective teachers: A validity and reliability study. Pamukkale University Journal of Education40(2): 160–175.
3.
AnaniadouKClaroM (2009) 21st Century skills and competences for new millennium learners in OECD countries. OECD Education Working Paper No. 41. Paris: OECD Publishing, doi:https://doi.org/10.1787/218525261154
4.
AskarPDavenportD (2009) An investigation of factors related to self-efficacy for Java Programming among engineering students. Online Submission8(1): 1–7.
5.
AvniERotemA (2016) Digital competence: A net of literacies. In: Handbook of Research on Technology Tools for Real-World Skill Development. vol. 1. https://doi.org/10.4018/978-1-4666-9441-5.ch00.
6.
BalciA (2009) Sosyal bilimlerde araştirma: Yöntem, teknik ve ilkeler [Research in social science: Methods, techniques and principles]. PegemA Pub.
7.
BanduraA. (1986) Social Foundations of Thought and Action.Englewood Cliffs, NJ: Prentice-Hall, vol. 2, pp.23–28.
8.
BanduraA (1977) Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review84(2): 191–215.
9.
BauerATAhooeiEM (2018) Rearticulating internet literacy. Journal of Cyberspace Studies2(1): 29–53.
10.
BüyüköztürkŞ (2002) Sosyal bilimler için veri analizi el kitabi [Data analysis for social sciences hand book]. PegemA Pub.
11.
CalaguasNPConsunjiPMP (2022) A structural equation model predicting adults’ online learning self-efficacy. Education and Information Technologies27(5): 6233–6249.
12.
CarminesEGZellerRA (1982) Reliability and validity assessment. Sage Publications Inc.
13.
CeylanBAteş ÇobanoğluAAnagünŞS, et al. (2023) Self-efficacy perceptions of 21st century skills, teaching skills use and educational technology use of Turkish primary school teachers: A SEM approach. International Journal of Educational Research Review8(3): 582–595.
14.
ChambaLTChikusvuraN (2024) Future-proofing quality education using integrated assessment systems. Quality Education for All1(1): 240–255.
15.
ChuenchomSJairakKKowanU (2021) Digital literacy skill development of Chiang Mai Rajabhat University students for improving learning quality. Journal of Information Science39(2): 16–33.
16.
ÇoklukÖŞekercioğluGBüyüköztürkŞ (2010) Sosyal bilimler için çok değişkenli istatistik: Spss ve Lisrel uygulamalari [Multivariable statistics for social sciences: SPSS and Lisrel applications].PegemA pub.
17.
CyphertFRGantWL (1970) The Delphi technique: A tool for collecting opinions in teacher education. Journal of Teacher Education21(3): 417–425.
18.
DaviesRS (2011) Understanding technology literacy: A framework for evaluating educational technology integration. TechTrends55(5): 45–52.
19.
DeVellisRF (2014) Ölçek geliştirme: Kuram ve uygulamalar [Scale development: Theory and practices].Nobel Ankara Pub.
20.
DhirHK, (Ed.). (2021) Handbook of Research on Barriers for Teaching 21st-Century Competencies and the Impact of Digitalization. IGI Global.
21.
DilekçiAKaratayH (2023) The effects of the 21st century skills curriculum on the development of students’ creative thinking skills. Thinking Skills And Creativity47: 101229.
22.
DinlerHSimsarAYalçinV (2021) Examining 21st century skills of 3-6 years old children in terms of some variables. e-Kafkas Journal of Educational Research8(2): 281–303.
23.
European Commission, Directorate-General for Communication Networks, Content and Technology (2018) A Multi-Dimensional Approach to Disinformation: Report of the Independent High Level Group on Fake News and Online Disinformation. Publications Office of the European Union.
24.
DoungpitakMChomtohsuwanTKraiwanitT, et al. (2023) Factors influencing digital technology skills in the developing country [special issue]. Corporate & Business Strategy Review4(2): 251–259.
25.
EroğluA (2008) Faktör analizi [factor analyses]. In: KalayciŞ (ed) SPSS uygulamali çok Değişkenli Istatistik Teknikleri [Statistics Techniques with Multi variable in SPSS Applications]. Asil Publishers, 321–331.
26.
ErolH (2021) Reflections on the 21st century skills into the curriculum of social studies course. International Journal of Education and Literacy Studies9(2): 90–101.
27.
FerrariA (2012) Digital Competence in Practice: An Analysis of Frameworks.Publications Office of the European Union.
28.
GorsuchRL (1983) Factor analysis. Lawrence Erlbaum Associates.
29.
GreenRA (2014) The delphi technique in educational research. Sage Open4(2): 1–8.
30.
GürültüEAslanMAlciB (2019) Competence for 21st century skills use of secondary school teachers. Hacettepe University Journal of Education34(1): 1–22. DOI: https://doi.org/10.16986/HUJE.2019051590.
31.
HairJFBlackWCBabinBJ, et al. (2010) Multivariate Data Analysis (7th ed.). Pearson Prentice Hall.
32.
HarishreeCMekalaSGeethaR (2023) Promoting 21st century workplace preparedness of engineering students: Teachers’ and students’ perceptions. MIER Journal of Educational Studies Trends and Practices13(2): 212–230. doi:https://doi.org/10.52634/mier/2023/v13/i2/2391.
33.
HazarE (2018) Information, Media and technology skills competency scale: A validity and reliability study. Journal of Human Sciences15(2): 1306–1316.
34.
HovardaoğluS (2000) Davraniş bilimleri için araştirma teknikleri [Research techniques for behavioral science].Ve-Ga Pub.
35.
ISTE (2019) The ISTE (International Society for Technology in Education) National Educational Technology Standards (NETS-S) and Performance Indicators for Students. Retrieved April 17, 2022, from http://www.iste.org/standards/nets-for-students
36.
KalemkuşFBulut ÖzekM (2021) Research trends of the 21st century skills: 2000-2020 (January). MANAS Journal of Social Studies10(2): 878–900.
37.
KennedyTJSundbergCW (2020) 21st Century skills. In AkpanBKennedyTJ (Eds), Science Education in Theory and Practice: An Introductory Guide to Learning Theory. Springer International Publishing, pp.479–496.
38.
KhlaisangJKoraneekijP (2019) Open online assessment management system platform and instrument to enhance the information, media, and ICT literacy skills of 21st century learners. International Journal of Emerging Technologies in Learning (iJET)14(07): 111–127.
39.
KivunjaC (2015) Teaching students to learn and to work well with 21st century skills: Unpacking the career and life skills domain of the new learning paradigm. International Journal of Higher Education4(1): 1–11.
40.
KlineP (1994) An Easy Guide to Factor Analysis (1st ed.). Routledge.
41.
KlineRB (2005) Principles and Practice of Structural Equation Modeling (2nd ed.). Guilford Press.
42.
KozikoğluİAltunovaN (2018) The predictive power of prospective teachers’ self-efficacy perceptions of 21st century skills for their lifelong learning tendencies. Journal of Higher Education and Science8(3): 522–531.
43.
KurbanogluS (2003) Self-efficacy: A concept closely linked to information literacy and lifelong learning. Journal of Documentation59(6): 635–646.
44.
LangVŠorgoA (2024) Views of students, parents, and teachers on smartphones and tablets in the development of 21st-century skills as a prerequisite for a sustainable future. Sustainability16(7): 3004.
45.
LarsonLCMillerTN (2011) 21st Century skills: Prepare students for the future. Kappa Delta Pi Record47(3): 121–123.
46.
LedwardBCHirataD (2011) An overview of 21st century skills. In Summary of 21st Century Skills for Students and Teachers. Pacific Policy Research Center, Honolulu, Kamehameha Schools–Research & Evaluation, pp.1–4.
47.
Martínez-BravoMCSádaba ChalezquerCSerrano-PucheJ (2022) Dimensions of digital literacy in the 21st century competency frameworks. Sustainability14(3): 1867.
48.
MusharrafSBaumanSAnis-ul-HaqueM, et al. (2018) Development and validation of ICT self-efficacy scale: Exploring the relationship with cyberbullying and victimization. International Journal of Environmental Research and Public Health15(12): 2867.
49.
NworieJ (2011) Using the Delphi technique in educational technology research. TechTrends55: 24–30.
50.
OcakGKarakuşG (2018) Pre-service teachers’ digital literacy self-efficacy scale development. Kastamonu Education Journal26(5): 1427–1436.
51.
OlorunfemiA (2023) 21st century skills: Literacy skills, learning and innovation skills and life and career skills (flips).
52.
OlurBOcakG (2021) Digital literacy self-efficacy scale: A scale development study. African Educational Research Journal9(2): 581–590.
PajaresFMillerMD (1994) Role of self-efficacy and self-concept beliefs in mathematical problem solving: A path analysis. Journal of Educational Psychology86(2): 193–203.
55.
PeciuliauskienePTamoliuneGTrepuleE (2022) Exploring the roles of information search and information evaluation literacy and pre-service teachers’ ICT self-efficacy in teaching. International Journal of Educational Technology in Higher Education19(1): 1–19.
56.
PhakitiA (2020) Likert-type scale construction. In The Routledge Handbook of Second Language Acquisition and Language Testing. Routledge, pp.102–114.
57.
PohlmannJT (2004) Use and interpretation of factor analysis in the journal of educational research: 1992-2002. The Journal of Educational Research98(1): 14–23.
58.
RaykovTMarcoulidesGA (2006) A First Course Structural Equation Modeling.New Jersey: Lawrence Erlbaum Associates, p.4.
59.
RussellDW (2002) In search of underlying dimensions: The use (and abuse) of factor analysis in personality and social psychology bulletin. Personality and Social Psychology Bulletin28(12): 1629–1646.
60.
RustikaIM (2012) Efikasi diri: Tinjauan teori albert bandura. Buletin Psikologi20(1-2): 18–25.
61.
ŞahinAE (2001) Delphi technique and its uses in educatoinal research. Hacettepe University Journal of Education Faculty20(20): 215–220.
62.
SaiyasitPSuwannoP (2022) Assessment of the current state and needs related to development of information and communication technology skills in 21st century learning management for municipal school teachers, the local administrative organization, Yala province. Library and Information Science Srinakharinwirot University14(2): 24–34. https://so02.tci-thaijo.org/index.php/JLIS_SWU/article/view/249750
63.
SamoylenkoNZharkoLGlotovaA (2022) Designing online learning environment: ICT tools and teaching strategies. Athens Journal of Education9(1): 49–62.
64.
SchererRFWiebeFALutherDC, et al. (1988) Dimensionality of coping: Factor stability using the ways of coping questionnaire, Psychological Reports62(3): 763–770.
65.
SchunkDH (1989) Self-efficacy and achievement behaviors. Educational Psychology Review1: 173–208.
66.
Serap KurbanogluSAkkoyunluBUmayA (2006) Developing the information literacy self-efficacy scale. Journal of Documentation62(6): 730–743.
67.
SpisakJR (2018) Secondary Student Information Literacy Self-Efficacy vs. Performance (Order No. 28000568). Available from ProQuest Dissertations & Theses Global; Publicly Available Content Database. (2420060240).
68.
StamblerLG (2013) Critical literacy: Literacies for the digital age to teach in the k-12 classroom.New Haven, CT: Presentation developed for the Pier Institute at Yale University.
69.
TabachnickBGFidellLS (2007) Using Multivariate Statistics (5th ed.). Pearson Education, Inc.
70.
TavşancilE (2010) Tutumlarin ölçülmesi ve Spss ile Veri Analizi [Measurement of Attitudes, and Data Analysis with SPSS] (4th ed.) Nobel Pub., pp.93–124.
71.
TechataweewanWPrasertsinU (2018) Development of digital literacy indicators for Thai undergraduate students using mixed method research. Kasetsart Journal of Social Sciences39(2): 215–221.
72.
ThangarasuSDe PaulSV (2014) Development and validation of teacher computer self efficacy scale. IOSR Journal of Humanities and Social Science19(1): 33–39.
73.
ThompsonB (2000) Ten commandments of structural equation modeling. In GrimmLGYarnoldPR (Eds), Reading and Understanding MORE Multivariate Statistics, pp.261–283.
74.
TuğlukMNÖzkanB (2019) Analysis of MoNE 2013 pre-school education program in terms of 21st-century skills. Journal of Primary Education1(4): 29–38.
75.
TutalÖ (2023) Examining the relationship between preservice teachers’ 21st century skills and educational philosophy tendencies. Journal of Sustainable Educational Studies (JSES)4(4): 261–276.
76.
UluyolÇEryilmazS (2015) Evaluation of FATIH project in the consideration of 21st century skills. Gazi University Journal of Gazi Educational Faculty (GUJGEF)35(2): 209–229.
77.
ValtonenTHoangNSointuE, et al. (2021) How pre-service teachers perceive their 21st-century skills and dispositions: A longitudinal perspective. Computers in Human Behavior116: 106643.
78.
WanGGutDM (Eds). (2011) Bringing schools into the 21st century (Vol. 13). Springer Science & Business Media.
79.
WangYYChuangYW (2024) Artificial intelligence self-efficacy: Scale development and validation. Education and Information Technologies29: 4785–4808. doi:https://doi.org/10.1007/s10639-023-12015-w.
80.
WinahyuRAEDjonoD (2018) The Media literacy in the 21st century: The role of teacher in historical learning. International Journal of Multicultural and Multireligious Understanding5(4): 363–369.
81.
YildirimROrtakŞ (2021) Determining the level of using 21st-century learning and innovation skills of secondary school students. Turkish Studies-Education Sciences16(6): 2683–2701.
82.
YilmazVÇelikE (2009) Lirsel ile Yapisal Eşitlik Modellemesi I [Structural Equation Modeling with Lisrel]. PegemA Pub, pp.53.
