Teachers are increasingly using augmented reality (AR) to develop students’ higher-order thinking (HOT). As past studies showed mixed results, our random effects meta-analysis of 21 effect sizes from 17 studies of 1256 participants determined the overall effect of AR on HOT and accounted for differences across studies via moderator effects. AR had a large positive overall effect on HOT (g = 1.109, 95% CI [0.699, 1.518]) but differed significantly across studies. AR effects on HOT were (a) largest for 3D visualization (g = 1.216), with progressively smaller ones for immersion (g = 1.198), collaboration (g = 0.934) and contextualization (g = 0.408), (b) larger for skills (g = 1.243) than disposition (g = 0.371), and (c) larger for convergent HOT (g = 1.625) than divergent HOT (g = 0.395).
*AbdelrahimA. A. M. (2023). The impact of a critical fiction analysis based on using augmented reality technology on developing students’ critical thinking and critical writing at Tabuk University. In Language teaching research. Advance online publication. Avaialble at: https://doi.org/10.1177/13621688231155578
2.
AkçayırM.AkçayırG. (2017). Advantages and challenges associated with augmented reality for education: A systematic review of the literature. Educational Research Review, 20(1), 1–11. https://doi.org/10.1016/j.edurev.2016.11.002
3.
AkçayırM.AkçayırG.PektaşH. M.OcakM. A. (2016). Augmented reality in science laboratories: The effects of augmented reality on university students’ laboratory skills and attitudes toward science laboratories. Computers in Human Behavior, 57(1), 334–342. https://doi.org/10.1016/j.chb.2015.12.054
4.
*AlzahraniA.Al-HafdiF. (2021). Effectiveness of augmented reality in developing the reflective thinking skills among secondary school students. Multicultural Education, 7(1), 1. https://doi.org/10.5281/zenodo.5294802
5.
*AngrainiL. M.AlzaberA.SariD. P.MuhammadI. (2023). Augmented reality: improvement of critical thinking based on students’ initial mathematical Ability. Indonesian Journal of Teaching and Learning, 2(1), 137–152. https://doi.org/10.56855/intel.v2i1.176
6.
BearM.ConnorsB.ParadisoM. A. (2020). Neuroscience. Jones & Bartlett Learning.
7.
BorensteinM.HedgesL. V.HigginsJ. P. T.RothsteinH. R. (2009). Introduction to meta-analysis. John Wiley & Sons, Ltd.
8.
BrunerJ. (1973). The relevance of education. W.W. Norton & Company.
9.
CaudellT. P.MizellD. W. (1992). Augmented reality: An application of heads-up display technology to manual manufacturing processes. Proceedings of the Twenty Fifth Hawaii International Conference on System Sciences, 2(1), 659–669. https://doi.org/10.1109/HICSS.1992.183317
10.
ChangH. Y.BinaliT.LiangJ.-C.ChiouG.-L.ChengK.-H.LeeS. W.-Y.TsaiC.-C. (2022). Ten years of augmented reality in education: A meta-analysis of (quasi-) experimental studies to investigate the impact. Computers & Education, 191(1), 104641. https://doi.org/10.1016/j.compedu.2022.104641
11.
*ChangH. Y.HsuY. S.WuH. K.TsaiC. C. (2018). Students’ development of socio-scientific reasoning in a mobile augmented reality learning environment. International Journal of Science Education, 40(12), 1410–1431. https://doi.org/10.1080/09500693.2018.1480075
12.
ChangY. S. (2021). Applying the ARCS motivation theory for the assessment of AR digital media design learning effectiveness. Sustainability, 13(1), 12296. https://doi.org/10.3390/su132112296
CohenJ.WestS. G.AikenL.CohenP. (2003). Applied multiple regression/ correlation analysis for the behavioral sciences. Lawrence Erlbaum.
15.
CraigA. B. (2013). Understanding augmented reality: Concepts and applications. Morgan Kaufmann.
16.
*DamopoliiI.PaikiF. F.NunakiJ. H. (2022). The development of comic book as marker of augmented reality to raise students’ critical thinking. TEM Journal, 11(1), 348–355. https://doi.org/10.18421/TEM111-44
17.
DanielM. F.GagnonM. (2011). Developmental process of dialogical critical thinking in groups of pupils aged 4 to 12 years. Creative Education, 02(05), 418–428. https://doi.org/10.4236/ce.2011.25061
18.
DemirciogluT.KarakusM.UcarS. (2023). Developing students’ critical thinking skills and argumentation abilities through augmented reality–based argumentation activities in science classes. Science & Education, 32(4), 1165–1195. https://doi.org/10.1007/s11191-022-00369-5
19.
DeshpandeA.KimI. (2018). The effects of augmented reality on improving spatial problem solving for object assembly. Advanced Engineering Informatics, 38(1), 760–775. https://doi.org/10.1016/j.aei.2018.10.004
20.
Di SerioÁ.IbáñezM. B.KloosC. D. (2013). Impact of an augmented reality system on students’ motivation for a visual art course. Computers & Education, 68(1), 586–596. https://doi.org/10.1016/j.compedu.2012.03.002
21.
*DuttaR.MantriA.SinghG.SinghN. P. (2023). Measuring the impact of augmented reality in flipped learning mode on critical thinking, learning motivation, and knowledge of engineering students. Journal of Science Education and Technology, 32(6), 912–930. https://doi.org/10.1007/s10956-023-10051-2
22.
EggerM.Davey SmithG.SchneiderM.MinderC. (1997). Bias in meta-analysis detected by a simple, graphical test. British Medical Journal, 315(7109), 629–634. https://doi.org/10.1136/bmj.315.7109.629
23.
*FaridiH.TuliN.MantriA.SinghG.GargrishS. (2021). A framework utilizing augmented reality to improve critical thinking ability and learning gain of the students in Physics. Computer Applications in Engineering Education, 29(1), 258–273. https://doi.org/10.1002/cae.22342
24.
Ferrer-TorregrosaJ.TorralbaJ.JimenezM. A.GarcíaS.BarciaJ. M. (2015). Arbook: Development and assessment of a tool based on augmented reality for anatomy. Journal of Science Education and Technology, 24(1), 119–124. https://doi.org/10.1007/s10956-014-9526-4
25.
GarzónJ.AcevedoJ. (2019). Meta-analysis of the impact of augmented reality on students’ learning gains. Educational Research Review, 27(1), 244–260. https://doi.org/10.1016/j.edurev.2019.04.001
26.
GarzónJ.PavónJ.BaldirisS. (2019). Systematic review and meta-analysis of augmented reality in educational settings. Virtual Reality, 23(4), 447–459. https://doi.org/10.1007/s10055-019-00379-9
27.
*GunturM. I. S.SetyaningrumW. (2021). The effectiveness of augmented reality in learning vector to improve students’ spatial and problem-solving skills. International Journal of Interactive Mobile Technologies, 15(5), 159–173. https://doi.org/10.3991/ijim.v15i05.19037
28.
HendersonL.KlemesJ.EshetY. (2000). Just playing a game? Educational simulation software and cognitive outcomes. Journal of Educational Computing Research, 22(1), 105–129. https://doi.org/10.2190/EPJT-AHYQ-1LAJ-U8WK
29.
*HerliandryL. D.KuswantoH.HidayatullohW. (2021). Improve critical thinking ability through augmented reality assisted worksheets. In 6th international seminar on science education (ISSE 2020) (pp. 470–475). Atlantis Press. Avaialble at: https://doi.org/10.2991/assehr.k.210326.067
30.
HigginsJ. P. T.ThompsonS. G.DeeksJ. J.AltmanD. G. (2003). Measuring inconsistency in meta-analyses. British Medical Journal, 327(7414), 557–560. https://doi.org/10.1136/bmj.327.7414.557
31.
Huedo-MedinaT. B.Sánchez-MecaJ.Marín-MartínezF.BotellaJ. (2006). Assessing heterogeneity in meta-analysis: Q statistic or I2 index?Psychological Methods, 11(2), 193–206. https://doi.org/10.1037/1082-989x.11.2.193
32.
IbáñezM. B.Uriarte PortilloA.Zatarain CabadaR.BarrónM. L. (2020). Impact of augmented reality technology on academic achievement and motivation of students from public and private Mexican schools. A case study in a middle-school geometry course. Computers & Education, 145(1), 103734. https://doi.org/10.1016/j.compedu.2019.103734
33.
*KangY.LeeI. (2023). The effect of mixed reality-based HoloPatient in problem-based learning contexts. Clinical Simulation in Nursing, 82(1), 101438. https://doi.org/10.1016/j.ecns.2023.101438
34.
*KaragozluD. (2018). Determination of the impact of augmented reality application on the success and problem-solving skills of students. Quality and Quantity, 52(5), 2393–2402. https://doi.org/10.1007/s11135-017-0674-5
35.
KhouryB.LecomteT.FortinG.MasseM.TherienP.BouchardV.ChapleauM. A.PaquinK.HofmannS. G. (2013). Mindfulness-based therapy: A comprehensive meta-analysis. Clinical Psychology Review, 33(6), 763–771. https://doi.org/10.1016/j.cpr.2013.05.005
36.
KmetL. M.LeeR. C.CookL. C. (2011). Standard quality assessment criteria for evaluating primary research papers from a variety of fields. Alberta Heritage Foundation for Medical Research. Avaialble at: https://era.library.ualberta.ca/items/48b9b989-c221-4df6-9e35-af
*LinX. F.HwangG. J.WangJ.ZhouY.LiW.LiuJ.LiangZ. M. (2023). Effects of a contextualised reflective mechanism-based augmented reality learning model on students’ scientific inquiry learning performances, behavioural patterns, and higher order thinking. Interactive Learning Environments, 31(10), 6931–6951. https://doi.org/10.1080/10494820.2022.2057546
39.
*LinY.-J.WangH.-C. (2023). Applying augmented reality in a university English class: Learners’ perceptions of creativity and learning motivation. Innovation in Language Learning and Teaching, 17(2), 291–305. https://doi.org/10.1080/17501229.2022.2040513
40.
MaoW.CuiY.ChiuM. M.LeiH. (2022). Effects of game-based learning on students’ critical thinking: A meta-analysis. Journal of Educational Computing Research, 59(8), 1682–1708. https://doi.org/10.1177/07356331211007098
41.
MartinsN. C.MarquesB.AlvesJ.AraújoT.DiasP.SantosB. S. (2022). Augmented reality situated visualization in decision-making. Multimedia Tools and Applications, 81(11), 14749–14772. https://doi.org/10.1007/s11042-021-10971-4
42.
MiriB.DavidB.-C.UriZ. (2007). Purposely teaching for the promotion of higher-order thinking skills: A case of critical thinking. Research in Science Education, 37(4), 353–369. https://doi.org/10.1007/s11165-006-9029-2
43.
MuschJ.OstapczukM.KlaiberY. (2012). Validating an inventory for the assessment of egoistic bias and moralistic bias as two separable components of social desirability. Journal of Personality Assessment, 94(6), 620–629. https://doi.org/10.1080/00223891.2012.672505
44.
NahmiasA. S.PellecchiaM.StahmerA. C.MandellD. S. (2019). Effectiveness of community-based early intervention for children with autism spectrum disorder: A meta-analysis. Journal of Child Psychology and Psychiatry, 60(11), 1200–1209. https://doi.org/10.1111/jcpp.13073
45.
ÖzdemirM.ŞahinÇ.ArcagokS.demirM. (2018). The effect of augmented reality applications in the learning process: A meta-analysis study. European Journal of Educational Research, 74(1), 165–186. https://doi.org/10.14689/ejer.2018.74.9
46.
RaduI. (2012). Why should my students use AR? A comparative review of the educational impacts of augmented-reality. In Proceedings of the 2012 IEEE international symposium on mixed and augmented reality (ISMAR). Avaialble at: https://doi.org/10.1109/ISMAR.2012.6402590
47.
ResnickL. B. (1987). Education and learning to think. National Academy Press.
48.
RobertoR.FreitasD.LimaJ. P.TeichriebV.KelnerJ. (2011). ARBlocks: A concept for a dynamic blocks platform for educational activities. In Proceedings of the 2011 XIII symposium on virtual reality. Uberlandia. Avaialble at: https://doi.org/10.1109/SVR.2011.19
49.
RossS. G.BegenyJ. C. (2015). An examination of treatment intensity with an oral reading fluency intervention: Do intervention duration and student–teacher instructional ratios impact intervention effectiveness?Journal of Behavioral Education, 24(1), 11–32. https://doi.org/10.1007/s10864-014-9202-z
50.
*SetiawanB.RachmadtullahR.NulhakimL.WahyudianaE.IashaV. (2022). The utilization of augmented reality on online learning: The impact for students’ physics problem-solving ability. AIP Conference Proceedings, 2542(1), 060011. https://doi.org/10.1063/5.0103173
SinghG.SinghG.TuliN.MantriA. (2024). Hyperspace AR: An augmented reality application to enhance spatial skills and conceptual knowledge of students in trigonometry. Multimedia Tools and Applications, 83(21), 60881–60902. https://doi.org/10.1007/s11042-023-17870-w
StrettonT.CochraneT.SevignyC.RathnerJ. (2024). Exploring mobile mixed reality for critical thinking in nursing and healthcare education: A systematic review. Nurse Education Today, 133(1), 106072. https://doi.org/10.1016/j.nedt.2023.106072
55.
StupniskyR. H.RenaudR. D.DanielsL. M.HaynesT. L.PerryR. P. (2008). The interrelation of first-year college students’ critical thinking disposition, perceived academic control, and academic achievement. Research in Higher Education, 49(6), 513–530. https://doi.org/10.1007/s11162-008-9093-8
56.
*SupliA. A.YanX. (2024). Exploring the effectiveness of augmented reality in enhancing spatial reasoning skills: A study on mental rotation, spatial orientation, and spatial visualization in primary school students. Education and Information Technologies, 29(1), 351–374. https://doi.org/10.1007/s10639-023-12255-w
57.
*SuryantiS.ArifaniY.SutajiD. (2020). Augmented reality for integer learning: Investigating its potential on students’ critical thinking. Journal of Physics: Conference Series, 1613(1), 012041. https://doi.org/10.1088/1742-6596/1613/1/012041
58.
TekedereH.GökerH. (2016). Examining the effectiveness of augmented reality applications in education: A meta-analysis. International Journal of Environmental & Science Education, 11(1), 9469–9481. https://files.eric.ed.gov/fulltext/EJ1118774.pdf
59.
VarelaF. J.ThompsonE.RoschE. (2017). The embodied mind: Cognitive science and human experience. MIT press.
60.
WuH.-K.LeeS. W.-Y.ChangH.-Y.LiangJ.-C. (2013). Current status, opportunities and challenges of augmented reality in education. Computers & Education, 62(1), 41–49. https://doi.org/10.1016/j.compedu.2012.10.024
61.
XuW.-W.SuC.-Y.HuY.ChenC.-H. (2022). Exploring the effectiveness and moderators of augmented reality on science learning: A meta-analysis. Journal of Science Education and Technology, 31(5), 621–637. https://doi.org/10.1007/s10956-022-09982-z
62.
ZhanY.YanZ.WanZ. H.WangX.ZengY.YangM.YangL. (2023). Effects of online peer assessment on higher-order thinking: A meta-analysis. British Journal of Educational Technology, 54(4), 817–835. https://doi.org/10.1111/bjet.13310
