The concept of Augmented Reality (AR) has evolved over the years since its inception in 1957. However, as of today, AR is mostly realized using a visual medium. Almost all applications of AR rely on the user’s ability to see. A few recent works have attempted to explore a new modality for AR–e.g., audio. However, the concept of using audio to augment reality has been considered debatable and there is no specific definition of the concept. To better understand this new concept, we launched a study using Grounded Theory to develop a definition and taxonomy for the concept of Audio Augmented Reality (AAR). This paper shares the preliminary results based on the activities conducted thus far, and hopes to generate discussion on using audio to augment reality within the Human Factors community.
Get full access to this article
View all access options for this article.
References
1.
BedersonB. B. (1995). Audio augmented reality: A prototype automated tour guide. Conference Companion on Human Factors in Computing Systems -CHI ’95, 210–211. https://doi.org/10.1145/223355.223526
2.
BlumJ. R.BouchardM.CooperstockJ. R. (2013). Spatialized Audio Environmental Awareness for Blind Users with a Smartphone. Mobile Networks and Applications, 18(3), 295–309. https://doi.org/10.1007/s11036-012-0425-8
3.
BoletsisC.ChasanidouD. (2018). Audio augmented reality in public transport for exploring tourist sites. Proceedings of the 10th Nordic Conference on Human-Computer Interaction, 721–725. https://doi.org/10.1145/3240167.3240243
4.
CavalcantiV. C.FerreiraM. I.deS.TeichriebV.BarioniR. R.CorreiaW. F. M.Da GamaA. E. F. (2019). Usability and effects of text, image and audio feedback on exercise correction during augmented reality based motor rehabilitation. Computers & Graphics, 85, 100–110. https://doi.org/10.1016/j.cag.2019.10.001
5.
Chun TieY.BirksM.FrancisK. (2019). Grounded theory research: A design framework for novice researchers. SAGE Open Medicine, 7, 205031211882292. https://doi.org/10.1177/2050312118822927
6.
ClasingJ. E.CasaliJ. G. (2014). Warfighter auditory situation awareness: Effects of augmented hearing protection/enhancement devices and TCAPS for military ground combat applications. International Journal of Audiology, 53, 43–52.
7.
DrascicDGrodskiJMilgramPRuffoKWongPZhaiS. (1993). A Display System for Augmenting Reality. InterCHI ‘93 Conf on Human Factors in Computing Systems, 88, 521.
8.
FurnissD.BlandfordA.CurzonP. (2011). Confessions from a grounded theory PhD: Experiences and lessons learnt. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 113–122. https://doi.org/10.1145/1978942.1978960
9.
HellerF.JevanesanJ.DietrichP.BorchersJ. (2016). Where are we?: Evaluating the current rendering fidelity of mobile audio augmented reality systems. Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services, 278–282. https://doi.org/10.1145/2935334.2935365
10.
HodaR.NobleJ.MarshallS. (2011). Grounded theory for geeks. Proceedings of the 18th Conference on Pattern Languages of Programs -PLoP ’11, 1–17. https://doi.org/10.1145/2578903.2579162
11.
JohnG.CasaliW. A. A.JeffA. Lancaster, & Auditory Systems Laboratory, V. T., Blacksburg, VA, U. S. Army Aeromedical Research Laboratory (USAARL), Fort Rucker, AL, USA. (2009). A field investigation of hearing protection and hearing enhancement in one device: For soldiers whose ears and lives depend upon it. Noise & Health, 11(42), 69–90.
12.
KaraM.CaveB. T.KicholLeeCasaliJohn G. (2019). Optimisation of an auditory azimuth localisation training protocol for military service members. INTERNATIONAL JOURNAL OF AUDIOLOGY. https://doi.org/10.1080/14992027.2019.1691747
13.
KhaledA.AlaliJ. G. C. (n.d.). The challenge of localizing vehicle backup alarms: Effects of passive and electronic hearing protectors, ambient noise level, and backup alarm spectral content. Noise & Health, 13(51), 99–112. https://doi.org/10.4103/1463-1741.77202
14.
KhaledAlaliCasaliJohn G. (2012). Auditory backup alarms: Distanceat-first- detection via in-situ experimentation on alarm design and hearing protection effects. Work41, 3599–3607. https://doi.org/10.3233/WOR-2012-0671-3599
15.
KrzyzaniakM.FrohlichD.JacksonP. J. B. (2019). Six types of audio that DEFY reality!: A taxonomy of audio augmented reality with examples. Proceedings of the 14th International Audio Mostly Conference: A Journey in Sound, 160–167. https://doi.org/10.1145/3356590.3356615
16.
LawtonM.CunninghamS.ConveryI. (2020). Nature soundscapes: An audio augmented reality experience. Proceedings of the 15th International Conference on Audio Mostly, 85–92. https://doi.org/10.1145/3411109.3411142
17.
MaculewiczJ.SerafinS. (2015). A Stationary Bike in Augmented Audio Reality. Proceedings of the 3rd 2015 Workshop on ICTs for Improving Patients Rehabilitation Research Techniques, 164–166. https://doi.org/10.1145/2838944.2838984
18.
MilgramP.KishinoFumio. (1994). A TAXONOMY OF MIXED REALITY VISUAL DISPLAYS. IEICE Transactions on Information Systems, Vol E77-D(No.12), 16.
19.
RumińskiD. (2015). An experimental study of spatial sound usefulness in searching and navigating through AR environments. Virtual Reality, 19(3–4), 223–233. https://doi.org/10.1007/s10055-0150274-4
20.
SikoraM.RussoM.ĐerekJ.JurčevićA. (2018). Soundscape of an Archaeological Site Recreated with Audio Augmented Reality. ACM Transactions on Multimedia Computing, Communications, and Applications, 14(3), 1–22. https://doi.org/10.1145/3230652
21.
SkarbezR.SmithM.WhittonM. C. (2021). Revisiting Milgram and Kishino’s Reality-Virtuality Continuum. Frontiers in Virtual Reality, 2, 647997. https://doi.org/10.3389/frvir.2021.647997
22.
Van KrevelenD. W. F.PoelmanR. (2010). A Survey of Augmented Reality Technologies, Applications and Limitations. International Journal of Virtual Reality, 9(2), 1–20. https://doi.org/10.20870/IJVR.2010.9.2.2767
23.
van NiekerkJ. C.RoodeJ. (2009). Glaserian and Straussian grounded theory: Similar or completely different?8.
24.
Vazquez-AlvarezY.AylettM. P.BrewsterS. A.JungenfeldR. V.VirolainenA. (2016). Designing Interactions with Multilevel Auditory Displays in Mobile Audio-Augmented Reality. ACM Transactions on Computer-Human Interaction, 23(1), 1–30. https://doi.org/10.1145/2829944
25.
Vazquez-AlvarezY.OakleyI.BrewsterS. A. (2012). Auditory display design for exploration in mobile audio-augmented reality. Personal and Ubiquitous Computing, 16(8), 987–999. https://doi.org/10.1007/s00779-011-0459-0
26.
WickensC. D. (2008). Multiple Resources and Mental Workload. Human Factors: The Journal of the Human Factors and Ergonomics Society, 50(3), 449–455. https://doi.org/10.1518/001872008X288394
27.
YangJ.ChanC. Y. (2019). Audio-augmented museum experiences with gaze tracking. Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia, 1–5. https://doi.org/10.1145/3365610.3368415
