Restricted accessResearch articleFirst published online 2020-10
Augmented Reality for Early Language Learning: A Systematic Review of Augmented Reality Application Design,Instructional Strategies,and Evaluation Outcomes
In this article, we present a systematic review of literature on augmented reality (AR) supported for early language learning. We analyzed a total of 53 papers from 2010 to 2019 using qualitative analysis with complementary descriptive quantitative analysis. Our findings revealed three main AR learning activities: word spelling games, word knowledge activities, and location-based word activities. Our findings also uncovered five main design strategies: three-dimensional multimedia content, hands-on interaction with physical learning materials, gamification, spatial mappings, and location-based features. Several combinations of design and instructional strategies tended to be effective: Learning gains were enhanced by using three-dimensional multimedia with advanced organizers (presentation strategy) and/or using location-based content with learners’ self-exploration (discovery strategy); and motivation was enhanced by using game mechanisms with discovery strategy. We suggest that future designers of AR early language applications should move beyond these basic approaches and consider how unique benefits of AR may be applied to support key activities in early language learning while also considering how to support sociotechnical factors such as collaboration between teachers and learners and different learning contexts. We conclude with a discussion of future directions for research in this emerging space.
AkçayırM.AkçayırG. (2017).
Advantages and challenges associated with augmented reality for education: A systematic review of the literature. Educational Research Review,
20, 1–11. https://doi.org/10.1016/j.edurev.2016.11.002
AntleA. N. (2013).
Research opportunities: Embodied child–computer interaction. International Journal of Child-Computer Interaction,
1(1), 30–36. https://doi.org/10.1016/j.ijcci.2012.08.001
4.
AntleA. N.FanM.CramerE. S. (2015). PhonoBlocks: A tangible system for supporting dyslexic children learning to read [Paper presentation]. 9th International Conference on Tangible, Embedded, and Embodied Interaction (pp. 533–538). ACM. https://doi.org/10.1145/2677199.2687897
5.
AntleA. N.WarrenJ. L.MayA.FanM.WiseA. F. (2014). Emergent dialogue: Eliciting values during children’s collaboration with a tabletop game for change [Paper presentation]. Proceedings of the 13th Conference on Interaction Design and Children (pp. 37–46). Association for Computing Machinery. https://doi.org/10.1145/2593968.2593971
BaccaJ.BaldirisS.FabregatR.GrafS. (2014).
Augmented reality trends in education: A systematic review of research and applications. Educational Technology & Society,
17(4), 133–149. https://www.jstor.org/stable/jeductechsoci.17.4.133
11.
BarreiraJ.BessaM.PereiraL. C.AdãoT.PeresE.MagalhãesL. (2012). MOW: Augmented Reality game to learn words in different languages: Case study: Learning English names of animals in elementary school [Paper presentation]. 7th Iberian Conference on Information Systems and Technologies (pp. 1–6). IEEE. https://ieeexplore.ieee.org/abstract/document/6263236
12.
BhadraA.BrownJ.KeH.LiuC.ShinE.WangX.KobsaA. (2016). ABC3D—Using an augmented reality mobile game to enhance literacy in early childhood [Paper presentation]. 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops) (pp. 1–4). IEEE. https://doi.org/10.1109/PERCOMW.2016.7457067
13.
BoonbrahmS.KaewratC.BoonbrahmP. (2015). Using augmented reality technology in assisting English learning for primary school students [Paper presentation]. Learning and Collaboration Technologies (pp. 24–32). Springer. https://doi.org/10.1007/978-3-319-20609-7_3
ChangY. J.ChenC. H.HuangW. T.HuangW. S. (2011). Investigating students’ perceived satisfaction, behavioral intention, and effectiveness of English learning using augmented reality [Paper presentation]. 2011 IEEE International Conference on Multimedia and Expo (pp. 1–6). IEEE. 10.1109/ICME.2011.6012177
16.
ChenC.WangC. (2015). The effects of learning style on mobile augmented-reality-facilitated English vocabulary learning [Paper presentation]. 2015 2nd International Conference on Information Science and Security (pp. 1–4). IEEE. https://doi.org/10.1109/ICISSEC.2015.7371036
17.
ChenR. W.ChanK. K. (2019).
Using augmented reality flashcards to learn vocabulary in early childhood education. Journal of Educational Computing Research,
57(7), 1812–1831. https://doi.org/10.1177/0735633119854028
18.
ChenY.ZhouD.WangY.YuJ. (2017). Application of augmented reality for early childhood English teaching [Paper presentation]. 2017 International Symposium on Educational Technology (pp. 111–115). IEEE. https://doi.org/10.1109/ISET.2017.34
19.
ChengK. H.TsaiC. C. (2013).
Affordances of augmented reality in science learning: Suggestions for future research. Journal of Science Education and Technology,
22(4), 449–462. https://doi.org/10.1007/s10956-012-9405-9
20.
CiezaE.LujanD. (2018).
Educational mobile application of augmented reality based on markers to improve the learning of vowel usage and numbers for children of a kindergarten in Trujillo. Procedia Computer Science,
130, 352–358. https://doi.org/10.1016/j.procs.2018.04.051
21.
ClarkJ. M.PaivioA. (1991).
Dual coding theory and education. Educational Psychology Review,
3(3), 149–210. https://doi.org/10.1007/BF01320076
22.
ColwellJ.HutchisonA. C. (2015).
Supporting teachers in integrating digital technology into language arts instruction to promote literacy. Journal of Digital Learning in Teacher Education,
31(2), 56–63. https://doi.org/10.1080/21532974.2014.991813
23.
DalimC. S. C.PiumsomboonT.DeyA.BillinghurstM.SunarS. (2016). TeachAR: An interactive augmented reality tool for teaching basic English to non-native children [Paper presentation]. 2016 IEEE International Symposium on Mixed and Augmented Reality (pp. 344–345). IEEE. https://doi.org/10.1109/ISMAR-Adjunct.2016.0113
24.
DehaeneS. (2009). Reading in the brain: The new science of how we read (1st ed.).
Penguin Group.
25.
DunleavyM.DedeC.MitchellR. (2009).
Affordances and limitations of immersive participatory augmented reality simulations for teaching and learning. Journal of Science Education and Technology,
18(1), 7–22. https://doi.org/10.1007/s10956-008-9119-1
26.
EarnshawA.SeargeantA. (2005). Dealing with dyslexia and other reading difficulties.
Pearson/Prentice Hall.
27.
EhriL. C. (2014).
Orthographic mapping in the acquisition of sight word reading, spelling memory, and vocabulary learning. Scientific Studies of Reading,
18(1), 5–21. https://doi.org/10.1080/10888438.2013.819356
FanM.AntleA. N.CramerE. S. (2016). Design rationale: Opportunities and recommendations for tangible reading systems for children [Paper presentation]. 15th International Conference on Interaction Design and Children (pp. 101–112). ACM. https://doi.org/10.1145/2930674.2930690
30.
FanM.AntleA. N.HoskynM.NeustaedterC.CramerE. S. (2017). Why tangibility matters: A design case study of at-risk children learning to read and spell [Paper presentation]. 2017 Conference on Human Factors in Computing Systems (pp. 1805–1816). ACM Press. https://doi.org/10.1145/3025453.3026048
31.
FanM.AntleA. N.SarkerS. (2018). From tangible to augmented: Designing a PhonoBlocks reading system using everyday technologies [Paper presentation]. Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (pp. LBW555:1–LBW555:6). ACM Press. https://doi.org/10.1145/3170427.3188459
32.
FanM.BaishyaU.MclarenE.S.AntleA. N.SarkerS.VincentA. (2018a). Block talks: A tangible and augmented reality toolkit for children to learn sentence construction [Paper presentation]. Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (pp. LBW056:1–LBW056:6). ACM Press. https://doi.org/10.1145/3170427.3188576
33.
FrithU. (1985). Beneath the surface of developmental dyslexia. In K. Patterson, J. C. Marshall, & M. Coltheart (Eds.), Surface dyslexia: Neuropsychological and cognitive studies of phonological reading (pp. 301–330). Erlbaum.
34.
GlenbergA. M.BrownM.LevinJ. R. (2007).
Enhancing comprehension in small reading groups using a manipulation strategy. Contemporary Educational Psychology,
32(3), 389–399. https://doi.org/10.1016/j.cedpsych.2006.03.001
35.
GohW. B.KasunL. L. C.Fitriani, TanJ.ShouW. (2012). The i-Cube: Design considerations for block-based digital manipulatives and their applications [Paper presentation]. Designing Interactive Systems Conference (pp. 398–407). ACM. https://doi.org/10.1145/2317956.2318016
36.
HeJ.RenJ.ZhuG.CaiS.ChenG. (2014). Mobile-based AR application helps to promote EFL children’s vocabulary study [Paper presentation]. The 14th International Conference on Advanced Learning Technologies (pp. 431–433). IEEE. https://doi.org/10.1109/ICALT.2014.129
37.
HengeveldB.HummelsC.van BalkomH.VoortR.de MoorJ. (2013). Wrapping up LinguaBytes, for now [Paper presentation]. 7th International Conference on Tangible, Embedded and Embodied Interaction (pp. 237–244). ACM. https://doi.org/10.1145/2460625.2460664
38.
HoS. C.HsiehS. W.SunP. C.ChenC. M. (2017).
To activate English learning: Listen and speak in real life context with an AR featured u-learning system. Journal of Educational Technology & Society,
20(2), 176–187.
39.
HorneckerE.DünserA. (2007). Supporting early literacy with augmented books-experiences with an exploratory study [Paper presentation]. Proceedings of the German Society of Informatics Annual Conference (pp. 555–559). https://dl.gi.de/handle/20.500.12116/22549
40.
HsiehM. C.KuoF. R.LinH. C. K. (2014).
The effect of employing AR interactive approach on students’ English preposition learning performance. Journal of Computers and Applied Science Education,
1, 45–60. http://bit.kuas.edu.tw/∼jcase/2014/vol1/JCASE-2014-01-003.pdf
HungH. T.YangJ. C.HwangG. J.ChuH. C.WangC. C. (2018).
A scoping review of research on digital game-based language learning. Computers & Education,
126, 89–104. https://doi.org/10.1016/j.compedu.2018.07.001
43.
HunterS.KalanithiJ.MerrillD. (2010). Make a Riddle and TeleStory: Designing children’s applications for the Siftables Platform [Paper presentation]. Proceedings of the 9th International Conference on Interaction Design and Children (pp. 206–209). ACM. https://doi.org/10.1145/1810543.1810572
IbrahimA.HuynhB.DowneyJ.HöllererT.ChunD.O’donovanJ. (2018).
Arbis pictus: A study of vocabulary learning with augmented reality.IEEE Transactions on Visualization and Computer Graphics,
24(11), 2867–2874. https://doi.org/10.1109/TVCG.2018.2868568
46.
IbrahimN.AliN. M. (2018).
A conceptual framework for designing virtual heritage environment for cultural learning. Journal on Computing and Cultural Heritage,
11(2), 11. https://doi.org/10.1145/3117801
Ishii, H. and Ullmer, B. (1997). Tangible bits: towards seamless interfaces between people, bits and atoms. 1997 Conference on Human Factors in Computing Systems (pp. 234–241). ACM Press. https://dl.acm.org/doi/pdf/10.1145/258549.258715
49.
JuanC. M.LlopE.AbadF.LluchJ. (2010). Learning words using augmented reality [Paper presentation]. Advanced Learning Technologies, 2010 IEEE (pp. 422–426). IEEE. https://doi.org/10.1109/ICALT.2010.123
KellyK.PhillipsS. (2011). Teaching literacy to learners with dyslexia: A multisensory approach.
SAGE.
52.
KoutromanosG.SofosA.AvraamidouL. (2015).
The use of augmented reality games in education: A review of the literature. Educational Media International,
52(4), 253–271. https://doi.org/10.1080/09523987.2015.1125988
53.
KucukS.YilmazR. M.GoktasY. (2014).
Augmented reality for learning English: Achievement, attitude and cognitive load levels of students.Egitim Ve Bilim-Education and Science,
39(176), 393–404. https://doi.org/10.15390/EB.2014.3595
54.
LeeL.ChauC.ChauC.NgC. (2017). Using augmented reality to teach kindergarten students English vocabulary [Paper presentation]. 2017 International Symposium on Educational Technology (ISET) (pp. 53–57). IEEE. https://doi.org/10.1109/ISET.2017.20
55.
LiJ.van der SpekE. D.FeijsL.WangF.HuJ. (2017) Augmented reality games for learning: A literature review. In StreitzN.MarkopoulosP. (Eds.), Distributed, ambient and pervasive interactions (1st ed., pp. 612–626).
Springer. https://doi.org/10.1007/978-3-319-58697-7_46
56.
LiM. S.ChenM. Y.WhittinghillD. M.VorvoreanuM. (2015).
A pilot study exploring augmented reality to increase motivation of Chinese college students learning English. Computers in Education Journal,
25(1), 23–33. https://doi.org/10.1007/978-3-319-58697-7_46
57.
LimsukhawatS.KaewyounS.WongwatkitC.WongtaJ. (2016). A development of augmented reality-supported mobile game application based on jolly phonics approach to enhancing English phonics learning performance of ESL learners. In W. Chen, J. Yang, S. Murthy, S. Wong and S. Iyer (Eds.), Proceedings of the 24th International Conference on Computers in Education (1st ed., pp. 483–488). Asia Pacific Society for Computers in Education.
58.
LinC. Y.YuW. J.ChenW. J.HuangC. W.LinC. C. (2016). The effect of literacy learning via mobile augmented reality for the students with ADHD and reading disabilities [Paper presentation]. International Conference on Universal Access in Human-Computer Interaction (pp. 103–111). Springer. https://doi.org/10.1007/978-3-319-40238-3_11
59.
LunaJ.TreacyR.HasegawaT.CampbellA.ManginaE. (2018). Words worth learning-Augmented literacy content for ADHD students [Paper presentation]. 2018 IEEE Games, Entertainment, Media Conference (pp. 1–9). IEEE. https://doi.org/10.1109/GEM.2018.8516483
60.
MahadzirN. N.PhungL. F. (2013).
The use of augmented reality pop-up book to increase motivation in English language learning for national primary school. Journal of Research & Method in Education,
1(1), 26–38. https://doi.org/10.9790/7388-0112638
61.
MayerR. E. (2014). Cognitive theory of multimedia learning. In The Cambridge handbook of multimedia learning (2nd ed., pp. 43–71). Cambridge University Press.
62.
MilgramP.TakemuraH.UtsumiA.KishinoF. (1995).
Augmented reality: A class of displays on the reality-virtuality continuum. Telemanipulator and Telepresence Technologies,
2351, 282–293. https://doi.org/10.1117/12.197321
63.
MioduserD.Tur-KaspaH.LeitnerI. (2000).
The learning value of computer-based instruction of early reading skills. Journal of Computer Assisted Learning,
16(1), 54–63. https://doi.org/10.1046/j.1365-2729.2000.00115.x
64.
MorenoR.MayerR. E.SpiresH. A.LesterJ. C. (2001).
The case for social agency in computer-based teaching: Do students learn more deeply when they interact with animated pedagogical agents?Cognition and Instruction,
19(2), 177–213. https://doi.org/10.1207/S1532690XCI1902_02
65.
NicolsonR.FawcettA.NicolsonM. (2000).
Evaluation of a computer-based reading intervention in infant and junior schools. Journal of Research in Reading,
23(2), 194–209. https://doi.org/10.1111/1467-9817.00114
66.
ÖzcanM. F.ÖzkanÂ.SahinN. (2017).
The influence of the augmented reality application on students’ performances in Ottoman Turkish readings. Universal Journal of Educational Research,
5, 27–33.
67.
PapadakiE.ZabulisX.NtoaS.MargetisG.KoutlemanisP.KaramaounasP.StephanidisC. (2013). The book of Ellie: An interactive book for teaching the alphabet to children [Paper presentation]. 2013 IEEE International Conference on Multimedia and Expo Workshops (pp. 1–6). IEEE. https://doi.org/10.1109/ICMEW.2013.6618341
68.
PriceS.SheridanJ. G.FalcaoT. P.RoussosG. (2008).
Towards a framework for investigating tangible environments for learning. International Journal of Arts and Technology,
1(3–4), 351–368. https://doi.org/10.1504/IJART.2008.022367
69.
PuM.ZhongZ. (2018). Development of a situational interaction game for improving preschool children’ performance in English-vocabulary learning [Paper presentation]. Proceedings of the 2018 International Conference on Distance Education and Learning (pp. 88–92). ACM. https://doi.org/10.1145/3231848.3231851
70.
RaduI. (2014).
Augmented reality in education: A meta-review and cross-media analysis.Personal and Ubiquitous Computing,
18(6), 1533–1543. https://doi.org/10.1007/s00779-013-0747-y
71.
RambliD. R. A.MatchaW.SulaimanS. (2013).
Fun learning with AR alphabet book for preschool children. Procedia Computer Science,
25, 211–219. https://doi.org/10.1016/j.procs.2013.11.026
72.
RelloL.BayarriC.GorrizA. (2012). What is wrong with this word? Dyseggxia: A game for children with dyslexia [Paper presentation]. Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility (pp. 219–220). ACM. https://doi.org/10.1145/2384916.2384962
73.
SadoskiM.PaivioA. (2013). Imagery and text: A dual coding theory of reading and writing (2nd ed.).
Routledge.
74.
SafarA. H.Al-JafarA. A.Al-YousefiZ. H. (2017).
The effectiveness of using augmented reality apps in teaching the English alphabet to kindergarten children: A case study in the state of Kuwait. EURASIA Journal of Mathematics, Science & Technology Education,
13(2), 417–440. https://doi.org/10.12973/eurasia.2017.00624a
75.
SansostiF. J.Powell-SmithK. A.KincaidD. (2004).
A research synthesis of social story interventions for children with autism spectrum disorders. Focus on Autism and Other Developmental Disabilities,
19(4), 194–204. https://doi.org/10.1177/10883576040190040101
76.
SantosM. E. C.ChenA.TaketomiT.YamamotoG.MiyazakiJ.KatoH. (2014).
Augmented reality learning experiences: Survey of prototype design and evaluation. IEEE Transactions on Learning Technologies,
7(1), 38–56. https://doi.org/10.1109/TLT.2013.37
77.
SantosM. E. C.TaketomiT.YamamotoG.RodrigoM. M. T.SandorC.KatoH. (2016).
Augmented reality as multimedia: The case for situated vocabulary learning.Research and Practice in Technology Enhanced Learning,
11(1), 4. https://doi.org/10.1186/s41039-016-0028-2
78.
SilvaM.RobertoR.TeichriebV. (2013).
Evaluating an educational system based on projective augmented reality. Brazilian Symposium on Computers in Education,
24(1), 214–223. http://dx.doi.org/10.5753/cbie.sbie.2013.214
79.
SlavinR. E. (1991). Student team learning: A practical guide to cooperative learning (3rd ed.).
National Education Association. https://eric.ed.gov/?id=ED339518
80.
SolakE.CakirR. (2015).
Exploring the effect of materials designed with augmented reality on language learners’ vocabulary learning. Journal of Educators Online,
12(2), 50–72. https://eric.ed.gov/?id=EJ1068381
81.
SongS. H.KellerJ. M. (2001).
Effectiveness of motivationally adaptive computer-assisted instruction on the dynamic aspects of motivation. Educational Technology Research and Development,
49(2), 5. https://doi.org/10.1007/BF02504925
SyllaC.PereiraI. S. P.CoutinhoC. P.BrancoP. (2016).
Digital manipulatives as scaffolds for preschoolers’ language development. IEEE Transactions on Emerging Topics in Computing,
4(3), 439–449. https://doi.org/10.1109/TETC.2015.2500099
84.
SysoevI.HershmanA.FineS.TraweekC.RoyD. (2017). SpeechBlocks: A constructionist early literacy app [Paper presentation]. 2017 Conference on Interaction Design and Children (pp. 248–257). ACM. https://doi.org/10.1145/3078072.3079720
85.
SytwuT. A.WangC. H. (2016). An investigation of the effects of individual differences on mobile-based augmented reality English vocabulary learning. In D. Churchill, J. Lu, T. Chiu, & B. Fox (Eds.), Mobile learning design (1st ed., pp. 387–410). Springer. https://doi.org/10.1007/978-981-10-0027-0_23
86.
TangT. Y.XuJ.WinotoP. (2019). Automatic object recognition in a light-weight augmented reality-based vocabulary learning application for children with autism [Paper presentation]. 3rd International Conference on Innovation in Artificial Intelligence (pp. 65–68). ACM. https://doi.org/10.1145/3319921.3319945
87.
TekedereH.GökeH. (2016).
Examining the effectiveness of augmented reality applications in education: A meta-analysis. International Journal of Environmental and Science Education,
11(16), 9469–9481. https://eric.ed.gov/?id=EJ1118774
88.
Vate-U-LanP. (2011). Augmented reality 3D pop-up children book: Instructional design for hybrid learning [Paper presentation]. 2011 5th IEEE International Conference on E-Learning in Industrial Electronics (pp. 95–100). IEEE. https://doi.org/10.1109/ICELIE.2011.6130033
89.
Vate-U-LanP. (2012). An augmented reality 3d pop-up book: The development of a multimedia project for English language teaching [Paper presentation]. Multimedia and Expo (pp. 890–895). IEEE. https://doi.org/10.1109/ICME.2012.79
90.
VellutinoF. R.FletcherJ. M.SnowlingM. J.ScanlonD. M. (2004).
Specific reading disability (dyslexia): What have we learned in the past four decades?Journal of Child Psychology and Psychiatry,
45(1), 2–40. https://doi.org/10.1046/j.0021-9630.2003.00305.x
91.
VernadakisN.AvgerinosA.TsitskariE.ZachopoulouE. (2005).
The use of computer assisted instruction in preschool education: Making teaching meaningful. Early Childhood Education Journal,
33(2), 99–104. https://doi.org/10.1007/s10643-005-0026-2
92.
WuH. K.LeeS. W. Y.ChangH. Y.LiangJ. C. (2013).
Current status, opportunities and challenges of augmented reality in education. Computers & Education,
62, 41–49. https://doi.org/10.1016/j.compedu.2012.10.024
93.
WuM. H. (2019). The applications and effects of learning English through augmented reality: A case study of Pokémon Go [Paper presentation]. Computer Assisted Language Learning (pp. 1–35). Routledge. https://doi.org/10.1080/09588221.2019.1642211
94.
YangH.TateM. (2009). Where are we at with cloud computing? A descriptive literature review [Paper presentation]. 20th Australasian Conference on Information Systems (pp. 807–819). AIS. https://aisel.aisnet.org/acis2009/26/
95.
YangJ. (2013).
Mobile assisted language learning: Review of the recent applications of emerging mobile technologies. English Language Teaching,
6(7), 19–25. http://dx.doi.org/10.5539/elt.v6n7p19
96.
YangX.KuoL.JiX.McTigueE. (2018).
A critical examination of the relationship among research, theory, and practice: Technology and reading instruction. Computers & Education,
125, 62–73. https://doi.org/10.1016/j.compedu.2018.03.009
97.
ZainuddinN.IdrusR. M. (2016). The use of augmented reality enhanced flashcards for Arabic vocabulary acquisition [Paper presentation]. 2016 13th Learning and Technology Conference (pp. 1–5). IEEE. https://doi.org/10.1109/LT.2016.7562857
98.
ZhenmingB.MayuU.MamoruE.TatamiY. (2017). Development of an English words learning system utilizes 3D markers with augmented reality technology [Paper presentation]. IEEE 6th Global Conference on Consumer Electronics (pp. 1–2). IEEE. https://doi.org/10.1109/GCCE.2017.8229353
99.
ZuckerT. A.MoodyA. K.McKennaM. C. (2009).
The effects of electronic books on pre-kindergarten-to-grade 5 students’ literacy and language outcomes: A research synthesis. Journal of Educational Computing Research,
40(1), 47–87. https://doi.org/10.2190/EC.40.1.c
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
