Objective: The objective of this study is to examine the effects of cue error on auditory spatial facilitation (ASF) of visual search. Background: ASF is the reduction in time needed to locate and identify a visual target when an auditory cue is presented at the location of the target. Although ASF has been shown to occur when the auditory cue coincides with the target location, it is important to determine whether facilitatory effects are also evident when the cue is displaced. Method: Participants performed a visual search task in the presence of an auditory cue that was presented at the center of the screen (uninformative), at the location of the target (accurate), or displaced up to 12° from the target horizontally or vertically. Results: Generally, displaced auditory cues reduced search times as compared with a condition in which the cue was uninformative. When the displacement was always along a single spatial dimension, the cue was as effective as a coincident cue if it was within the local visual area. However, when the dimension along which the cue was displaced varied randomly, the cue did not necessarily reduce search time and hurt performance when the visual search task was difficult. Conclusion: Designers of virtual audio displays should be aware that auditory cue accuracy will be affected by the difficulty of the visual task and the operators' knowledge of cue precision and reliability. Application: Findings from this study can be applied to the design of multimodal interfaces and augmented or virtual environments.
Get full access to this article
View all access options for this article.
References
1.
Boff, K. R., & Lincoln, J. E. (Eds.). (1988). Engineering data compendium: Human perception and performance (Vol. 1). Wright Patterson Air Force Base, OH: Armstrong Aerospace Medical Research Laboratory.
2.
Bolia, R. S., D'Angelo, W. R., & McKinley, R. L. (1999). Aurally aided visual search in three-dimensional space. Human Factors, 41, 664–669.
3.
Donk, M. (1994). Human monitoring behavior in a multiple-instrument setting: Independent sampling, sequential sampling or arrangement-dependent sampling. Acta Psychologica, 86, 31–55.
4.
Frens, M. A., Van Opstal, A. J., & Van der Willigen, R. F. (1995). Spatial and temporal factors determine auditory-visual interactions in human saccadic eye movements. Perception and Psychophysics, 57, 802–816.
5.
Hofman, P. M., & Van Opstal, A. J. (1998). Spectro-temporal factors in two-dimensional human sound localization. Journal of the Acoustical Society of America, 103, 2634–2648.
6.
McDonald, J. J., & Ward, L. M. (2000). Involuntary listening aids seeing: Evidence from human electrophysiology. Psychological Science, 11, 167–171.
7.
Mudd, S. A., & McCormick, J. (1960). The use of auditory cues in a visual search task. Journal of Applied Psychology, 44, 184–188.
8.
Nelson, T. W., Hettinger, L. J., Cunningham, J. A., Brickman, B. J., Haas, M. W., & McKinley, R. L. (1998). Effects of localized auditory information on visual target detection performance using a helmet-mounted display. Human Factors, 40, 452–460.
9.
Perrott, D. R., Cisneros, J., McKinley R. L., & D'Angelo, W. R. (1996). Aurally aided visual search under virtual and free-field listening conditions. Human Factors, 38, 702–715.
10.
Perrott, D. R., Constantino, B., & Cisneros, J. (1993). Auditory and visual localization performance in a sequential discrimination task. Journal of the Acoustical Society of America, 93, 2134–2138.
11.
Perrott, D. R., Saberi, K., Brown, K., & Strybel, T. Z. (1990). Auditory psychomotor coordination and visual search performance. Perception and Psychophysics, 48, 214–226.
12.
Perrott, D. R., Sadralodabai, T., Saberi, K., & Strybel, T. Z. (1991). Aurally aided visual search in the central visual field: Effects of visual load and visual enhancement of the target. Human Factors, 33, 389–400.
13.
Proctor, R. W., & Vu, K.-P. L. (2004). Attention and displays. In A. Johnson & R. W. Proctor (Eds.), Attention: Theory and practice (pp. 227–259). Thousand Oaks, CA: Sage.
14.
Rudmann, D. S., & Strybel, T. Z. (1999). Auditory spatial facilitation of visual search performance: Effect of cue precision and distractor density. Human Factors, 41, 146–160.
15.
Scharf, B. (1998). Auditory attention: The psychoacoustical approach. In H. Pashler (Ed.), Attention (pp. 75–118). East Sussex, UK: Psychology Press.
16.
Simon, J. R. (1990). The effects of an irrelevant directional cue on human information processing. In R. W. Proctor & T. G. Reeve (Eds.), Stimulus-response compatibility: An integrated perspective (pp. 31–86). Amsterdam: North-Holland.
17.
Strybel, T. Z., Boucher, J., Fujawa, G., & Volp, C. (1995). Auditory spatial cueing in visual search tasks: Effects of amplitude, contrast and duration. In Proceedings of the Human Factors and Ergonomics Society 39th Annual Meeting (pp. 109–114). Santa Monica, CA: Human Factors and Ergonomics Society.
18.
Strybel, T. Z., & Fujimoto, K. (2000). Minimum audible angles in the horizontal and vertical planes: Effects of stimulus onset asynchrony and burst duration. Journal of the Acoustical Society of America,108, 3092–3095.
19.
Toet, A., & Levi, D.M. (1992). The two-dimensional shape of spatial interaction zones in the parafovea. Vision Research, 32, 1349–1357.
20.
Williams, L. G. (1966). The effect of target specification on objects fixated during visual search. Perception and Psychophysics, 1, 315–319.
21.
Williams, L. G. (1973). Studies of extrafoveal discrimination and detection. In Committee on Vision, Division of Behavioral Sciences, National Research Council (Eds.), Visual search (pp. 77–92). Washington, DC: National Academy of Sciences.
