The goal of this project is to evaluate a new auditory cue, which the authors call spearcons, in comparison to other auditory cues with the aim of improving auditory menu navigation.
Background:
With the shrinking displays of mobile devices and increasing technology use by visually impaired users, it becomes important to improve usability of non-graphical user interface (GUI) interfaces such as auditory menus. Using nonspeech sounds called auditory icons (i.e., representative real sounds of objects or events) or earcons (i.e., brief musical melody patterns) has been proposed to enhance menu navigation. To compensate for the weaknesses of traditional nonspeech auditory cues, the authors developed spearcons by speeding up a spoken phrase, even to the point where it is no longer recognized as speech.
Method:
The authors conducted five empirical experiments. In Experiments 1 and 2, they measured menu navigation efficiency and accuracy among cues. In Experiments 3 and 4, they evaluated learning rate of cues and speech itself. In Experiment 5, they assessed spearcon enhancements compared to plain TTS (text to speech: speak out written menu items) in a two-dimensional auditory menu.
Results:
Spearcons outperformed traditional and newer hybrid auditory cues in navigation efficiency, accuracy, and learning rate. Moreover, spearcons showed comparable learnability as normal speech and led to better performance than speech-only auditory cues in two-dimensional menu navigation.
Conclusion: These results show that spearcons can be more effective than previous auditory cues in menu-based interfaces.
Application:
Spearcons have broadened the taxonomy of nonspeech auditory cues. Users can benefit from the application of spearcons in real devices.
AbsarR.GuastavinoC. (2008). Usability of non-speech sounds in user interfaces. In Susini, P. & Warusfel, O., Proceedings of the International Conference on Auditory Display (ICAD2008). Paris, France: IRCAM.
AsakawaC.ItohT. (1998). User interface of a home page reader. In Proceedings of the Annual ACM Conference on Assistive Technologies (ASSETS98) (pp. 149–156). Marina del Rey, CA.
4.
AsakawaC.TakagiH.InoS.IfukubeT. (2003). Maximum listening speeds for the blind. In Brazil, E. & Shinn-Cunningham, B., Proceedings of the International Conference on Auditory Display (ICAD2003) (pp. 276–279). Boston, MA: Boston University Publications.
BedersonB. B. (2000). Fisheye menus. In AckermanM.EdwardsK., Proceedings of the ACM Symposium on User Interface Software and Technology (UIST’00) (pp. 217–225). New York, NY: ACM.
7.
BlattnerM. M.SumikawaD. A.GreenbergR. M. (1989). Earcons and icons: Their structure and common design principles. Human-Computer Interaction, 4, 11–44.
8.
BrewsterS. (1997). Navigating telephone-based interfaces with earcons. In Thimbleby, H. W., O’Conaill, B., & Thomas, P., Proceedings of the BCS HCI’97 (pp. 39–56). Bristol, UK.
9.
BrewsterS. (1998). Using non-speech sounds to provide navigation cues. ACM Transactions on Computer-Human Interaction, 5, 224–259.
10.
BrewsterS.CreaseM. G. (1999). Correcting menu usability problems with sound. Behaviour and Information Technology, 18, 165–177.
11.
BrewsterS.RatyV.-P.KortekangasA. (1996). Earcons as a method of providing navigational cues in a menu hierarchy. In Sasse, M. A., Cunningham, J., & Winder, R. L., Proceedings of the BCS HCI’96 (pp. 169–183). London, UK: Imperial College.
12.
BrewsterS.WrightP. C.EdwardsA. D. N. (1993). An evaluation of earcons for use in auditory human-computer interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI93) (pp. 222–227). Amsterdam, Netherlands.
DinglerT.LindsayJ.WalkerB. N. (2008). Learnability of sound cues for environmental features: Auditory icons, earcons, spearcons, and speech. In Susini, P. & Warusfel, O., Proceedings of the International Conference on Auditory Display (ICAD2008). Paris, France: IRCAM.
15.
EdwardsA. D. N. (1989). Soundtrack: An auditory interface for blind users. Human-Computer Interaction, 4, 45–66.
16.
FindlaterL.McGrenereJ. (2004). A comparison of static, adaptive, and adaptable menus. In Dykstra-Erickson, E. & Tscheligi, M., Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’04) (pp. 89–96). New York, NY: ACM.
Gardner-BonneauD. J. (1992). Human factors problems in interactive voice response (IVR) applications: Do we need a guideline/ standard? In Proceedings of the Human Factors Society 36th Annual Meeting (HFES1992) (pp. 222–226). Santa Monica, CA: HFES. DOI: 10.1177/154193129203600101
19.
GaverW. W. (1986). Auditory icons: Using sound in computer interfaces. Human-Computer Interaction, 2, 167–177.
20.
GaverW. W. (1989). The SonicFinder, a prototype interface that uses auditory icons. Human-Computer Interaction, 4, 67–94.
21.
HejnaD. J.Jr. (1990). Real-time time-scale modification of speech via the synchronized overlap-add algorithm (Unpublished masters thesis). Massachusetts Institute of Technology, Cambridge, MA.
22.
JeonM.DavisonB. K.NeesM. A.WilsonJ.WalkerB. N. (2009). Enhanced auditory menu cues improve dual task performance and are preferred with in-vehicle technologies. In Schmidt, A., Dey, A., Seder, T., Juhlin, O., & Kern, D., Proceedings of the 1st International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI09) (pp. 91–98). New York, NY: ACM.
23.
JeonM.WalkerB. N. (2011). Spindex (Speech Index) improves auditory menu acceptance and navigation performance. ACM Transactions on Accessible Computing, 3, 10.
24.
KarshmerA.BrawnerP.ReiswigG. (1994). An experimental sound-based hierarchical menu navigation system for visually handicapped use of graphical user interfaces. In Proceedings of the Annual ACM Conference on Assistive Technologies (ASSETS94) (pp. 123–128). New York, NY: ACM.
25.
LePlatreG.BrewsterS. (1998). Designing non-speech sounds to support navigation in mobile phone menus. In Cook, P. R., Proceedings of the International Conference on Auditory Display (ICAD2000) (pp. 190–199). Atlanta, GA: ICAD.
26.
MoosA.TrouvainJ. (2007). Comprehension of ultra-fast speech—Blind vs. “normally hearing” persons. In TrouvainJ.BarryW. J. (Eds.), Proceedings of the 16th International Congress of Phonetic Sciences (pp. 677–680). Saarbrücken, Germany: Saarland University.
27.
MorleyS.PetrieH.O’NeillA. M.McNallyP. (1998). Auditory navigation in hyperspace: Design and evaluation of a non-visual hypermedia system for blind users. In Proceedings of the Annual ACM Conference on Assistive Technologies (ASSETS98). New York: ACM.
28.
MynattE. (1997). Transforming graphical interfaces into auditory interfaces for blind users. Human-Computer Interaction, 12, 7–45.
29.
MynattE.EdwardsW. (1992). Mapping GUIs to auditory interfaces. In Proceedings of the 5th Annual ACM Symposium on User Interface Software and Technology (pp. 61–70). New York: ACM.
30.
MynattE.WeberG. (1994). Nonvisual presentation of graphical user interfaces: Contrasting two approaches. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI94) (pp. 166–172). New York: ACM.
31.
NormanK. L. (1991). The psychology of menu selection: Designing cognitive control of the human/computer interface. Norwood, NJ: Ablex.
32.
PalladinoD. K.WalkerB. N. (2007). Learning rates for auditory menus enhanced with spearcons versus earcons. In Scavone, G. P., Proceedings of the 13th International Conference on Auditory Display (ICAD2007) (pp. 274–279). Montreal, Canada: ICAD.
33.
PalladinoD. K.WalkerB. N. (2008a). Efficiency of spearconenhanced navigation of one dimensional electronic menus. In Susini, P. & Warusfel, O., Proceedings of the International Conference on Auditory Display (ICAD2008). Paris, France: IRCAM.
34.
PalladinoD. K.WalkerB. N. (2008b). Navigation efficiency of two dimensional auditory menus using spearcon enhancements. In Proceedings of the Annual Meeting of the Human Factors and Ergonomics Society (HFES2008) (pp. 1262–1266). Santa Monica, CA: HFES. doi: 10.1177/154193120805201823
35.
PittI. J.EdwardsA. D. N. (1996). Improving the usability of speech-based interfaces for blind users. In Proceedings of the Annual ACM Conference on Assistive Technologies (ASSETS96) (pp. 124–130). New York, NY: ACM.
36.
PolkoskyM. D.LewisJ. R. (2001). The function of nonspeech audio in speech recognition applications: A review of the literature (IBM Voice Systems Technical Report, TR 29.3405). West Palm Beach, FL: IBM.
RamanT. V. (1997). Auditory user interfaces: Toward the speaking computer. Boston, MA: Kluwer.
39.
RoucosS.WilgusA. M. (1985). High quality time-scale modification for speech. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (pp. 493–496). New York, NY: IEEE. doi: 10.1109/ICASSP.1985.1168505
40.
SearsA.ShneidermanB. (1994). Split menus: Effectively using selection frequency to organize menus. ACM Transactions on Computer-Human Interaction, 1, 27–51.
41.
ShneidermanB. (1998). Designing the user interface: Strategies for effective human-computer-interaction (3rd ed.). Reading, MA: Addison-Wesley Longman.
42.
ThatcherJ. (1994). Screen reader/2 access to OS/2 and the graphical user interface. In Proceedings of the Annual ACM Conference on Assistive Technologies (ASSETS94) (pp. 39–46). New York, NY: ACM.
43.
VargasM. L. M.AndersonS. (2003). Combining speech and earcons to assist menu navigation. In Brazil, E. & Shinn-Cunningham, B., Proceedings of the International Conference on Auditory Display (ICAD2003) (pp. 38–46). Boston, MA: ICAD.
44.
WalkerB. N.NanceA.LindsayJ. (2006). Spearcons: Speechbased earcons improve navigation performance in auditory menus. In StockmanT.NickersonL.FrauenbergerC.EwardsA. D. N.BrockD., Proceedings of the 12th International Conference on Auditory Display (ICAD2006) (pp. 63-68). London, UK: ICAD.
45.
WickensC. D. (2002). Multiple resources and performance prediction. Theoretical Issues in Ergonomics Science, 3, 159–177.
46.
WilsonJ.WalkerB. N.LindsayJ.CambiasC.DellaertF. (2007). SWAN: System for wearable audio navigation. In Proceedings of the 11th International Symposium on Wearable Computers (ISWC 2007) (pp. 91–98). New York, NY: IEEE. doi: 10.1109/ISWC.2007.4373786
47.
WolfC.KovedL.KunzingerE. (1995). Ubiquitous mail: Speech and graphical interfaces to an integrated voice/email mailbox. In Nordby, K., Helmersen, P. H., Gilmore, D. J., & Arnesen, S. A. Proceedings of the IFIP Interact’95 (pp. 247–252). London: Chapman & Hall.
48.
YallaP.WalkerB. N. (2008). Advanced auditory menus: Design and evaluation of auditory scrollbars. In Harper, S. & Barreto, A., Proceedings of the Annual ACM Conference on Assistive Technologies (ASSETS’08) (pp. 105–112). New York, NY: ACM.
49.
ZhaoS.DragicevicP.ChignellM.BalakrishnanR.BaudischP. (2007). earPod: Eyes-free menu selection using touch input and reactive audio feedback. In BegoleB.PayneS.ChurchillE.St. AmantR.GilmoreD.RossonM. B., Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI07) (pp. 1395–1404). New York, NY: ACM.
