Learning and Retention of Associations Between Auditory Icons and Denotative Referents: Implications for the Design of Auditory Warnings

Abstract

Objective: This study examined the way in which the type and preexisting strength of association between an auditory icon and a warning event affects the ease with which the icon/event pairing can be learned and retained. Background: To be effective, an auditory warning must be audible, identifiable, interpretable, and heeded. Warnings consisting of familiar environmental sounds, or auditory icons, have potential to facilitate identification and interpretation. The ease with which pairings between auditory icons and warning events can be learned and retained is likely to depend on the type and strength of the preexisting icon/event association. Method: Sixty-three participants each learned eight auditory-icon/denotative-referent pairings and attempted to recall them 4 weeks later. Three icon/denotative-referent association types (direct, related, and unrelated) were employed. Participants rated the strength of the association for each pairing on a 7-point scale. Results: The number of errors made while learning pairings was greater for unrelated than for either related or direct associations, whereas the number of errors made while attempting to recall pairings 4 weeks later was greater for unrelated than for related associations and for related than for direct associations. Irrespective of association type, both learning and retention performance remained at very high levels, provided the strength of the association was rated greater than 5. Conclusion: This suggests that strong preexisting associations are used to facilitate learning and retention of icon/denotative-referent pairings. Application: The practical implication of this study is that auditory icons having either direct or strong, indirect associations with warning events should be preferred.

Get full access to this article

View all access options for this article.

References

Ballas, J. A. (1993). Common factors in the identification of an assortment of brief everyday sounds. Journal of Experimental Psychology: Human Perception and Performance, 19, 250–267.

Ballas, J. A. , & Mullins, T. (1991). Effects of context on the identification of everyday sounds. Human Performance, 4, 199–219.

Bartlett, J. C. (1977). Remembering environmental sounds: The role of verbalization at input. Memory and Cognition, 5, 404–414.

Belz, S. M. , Robinson, G. S. , & Casali, J. G. (1999). A new class of auditory warning signals for complex systems: Auditory icons. Human Factors, 41, 608–618.

Blattner, M. M. , Sumikawa, D. A. , & Greenberg, R. M. (1989). Earcons and icons: Their structure and common design principles. Human-Computer Interaction, 4, 11–44.

Bower, G. H. , & Holyoak, K. (1973). Encoding and recognition memory for naturalistic sounds. Journal of Experimental Psychology, 101, 360–366.

Brotsky, S. J. , & Linton, M. L. (1969a). Paired associate learning predicted from indices of free association strength. Psychonomic Science, 16, 305–307.

Brotsky, S. J. , & Linton, M. L. (1969b). Paired associate learning predicted from indices of free association strength: An extension. Psychonomic Science, 17, 65–66.

Familant, M. E. , & Detweiler, M. C. (1993). Iconic reference: Evolving perspectives and an organizing framework. International Journal of Man-Machine Studies, 39, 705–728.

10.

Gallagher, J. W. , & Reid, D. R. (1970). Effect of five free association strength values on paired-associate learning. American Journal of Mental Deficiency, 75, 33–38.

11.

Gaver, W. W. (1986). Auditory icons: Using sound in computer interfaces. Human-Computer Interaction, 2, 167–177.

12.

Gittins, D. (1986). Icon-based human-computer interaction. International Journal of Man-Machine Studies, 24, 519–543.

13.

Graham, R. (1999). Use of auditory icons as emergency warnings; Evaluation within a vehicle collision avoidance application. Ergonomics, 42, 1233–1248.

14.

Leung, Y. K. , Smith, S. , Parker, S. , & Martin, R. (1997). Learning and retention of auditory warnings. In E. Mynatt & J. A. Ballas (Eds.), Proceedings of the Fourth International Conference on Auditory Displays (pp. 129–133). Palo Alto, CA: Xerox Palo Alto Research Center.

15.

Linton, M. , Jewett, M. , & Brotsky, S. J. (1970). Prediction of paired-associate learning from a complex indicator of associative strength. Psychonomic Science, 21, 354–355.

16.

Meredith, C. S. , & Edworthy, J. (1991). Sources of confusion in intensive therapy unit alarms. In N. Stanton (Ed.), Human factors in alarm design (pp. 207–219). London: Taylor & Francis.

17.

Momtahan, K. , Hetu, R. , & Tansley, B. (1993). Audibility and identification of auditory alarms in the operating room and intensive care unit. Ergonomics, 36, 1159–1176.

18.

Morris, C. W. (1971). Writings on the general theory of signs. The Hague: Mouton.

19.

Noth, W. (1990). Handbook of semiotics. Bloomington: Indiana University Press.

20.

Paivio, A. , Philipchalk, R. , & Rowe, E. J. (1975). Free and serial recall of pictures, sounds and words. Memory and Cognition, 3, 586–590.

21.

Patterson, R. D. (1982). Guidelines for auditory warning systems on civil aircraft (CAA Paper 82017). London: Civil Aviation Authority.

22.

Patterson, R. D. , & Milroy, R. (1980). Auditory warnings on civil aircraft: The learning and retention of warnings (CAA Paper 7D/S/0142). London: Civil Aviation Authority.

23.

Peirce, C. S. (1955). Logic as semiotic: The theory of signs. In J. Buchler (Ed.), Philosophical writings of Peirce (pp. 98–128). New York: Dover.

24.

Peterson, L. R. (1965). Paired-associate latencies after the last error. Psychonomic Science, 2, 167–168.

25.

Philipchalk, R. P. , & Rowe, E. J. (1971). Sequential and nonsequential memory for verbal and nonverbal auditory stimuli. Journal of Experimental Psychology, 91, 341–343.

26.

Sanders, M. S. , & McCormick, E. J. (1987). Human factors in engineering and design. New York: McGraw-Hill.

27.

Shapiro, S. I. (1968). Paired-associate response latencies as a function of free association strength. Journal of Experimental Psychology, 77, 223–231.

28.

Smith, S. E. , Stephan, K. L. , Parker, S. , Martin, R. , & McAnally, K. (2001). Does signal-referent association strength affect learning of auditory icons [Abstract]? Australian Journal of Psychology, 53 (Suppl. 65).

29.

Stanton, N. , & Edworthy, J. (1998). Auditory affordances in the intensive treatment unit. Applied Ergonomics, 29, 389–394.

30.

Stephan, K. L. , Smith, S. E. , Parker, S. , Martin, R. , & McAnally, K. (2000). Auditory warnings in the cockpit: An evaluation of potential sound types. In G. Edkins & P. Pfister (Eds.), Innovation and consolidation in aviation (pp. 231–241). Aldershot, UK: Ashgate.