Aurally and Visually Guided Visual Search in a Virtual Environment

Abstract

We investigated the time participants took to perform a visual search task for targets outside the visual field of view using a helmet-mounted display. We also measured the effectiveness of visual and auditory cues to target location. The auditory stimuli used to cue location were noise bursts previously recorded from the ear canals of the participants and were either presented briefly at the beginning of a trial or continually updated to compensate for head movements. The visual cue was a dynamic arrow that indicated the direction and angular distance from the instantaneous head position to the target. Both visual and auditory spatial cues reduced search time dramatically, compared with unaided search. The updating audio cue was more effective than the transient audio cue and was as effective as the visual cue in reducing search time. These data show that both spatial auditory and visual cues can markedly improve visual search performance. Potential applications for this research include highly visual environments, such as aviation, where there is risk of overloading the visual modality with information.

Get full access to this article

View all access options for this article.

References

Barfield, W. , Cohen, M. , & Rosenberg, C. (1997). Visual and auditory localization as a function of azimuth and elevation. International Journal of Aviation Psychology, 7, 123–138.

Begault, D. R. (1993). Head-up auditory displays for traffic collision avoidance system advisories: A preliminary investigation. Human Factors, 35, 707–717.

Begault, D. R. , & Pitman, M. T. (1996). Three-dimensional audio versus head-down traffic alert and collision avoidance system displays. International Journal of Aviation Psychology, 6, 79–93.

Bronkhorst, A. W. , Veltman, J. A. , & van Breda, L. (1996). Application of a three-dimensional auditory display in a flight task. Human Factors, 38, 23–33.

Heffner, R. S. , & Heffner, H. E. (1992). Visual factors in sound localization in mammals. Journal of Comparative Neurology, 317, 219–232.

Møller, H. , Sorensen, M. F. , Jensen, C. B. , & Hammershøi, A. D. (1996). Binaural techniques: Do we need individual recordings? Journal of Audio Engineering, 44, 451–469.

Perrott, D. R. , Cisneros, J. , McKinley, R. L. , & D'Angelo. W. R. (1996). Aurally aided visual search under virtual and free-field listening conditions. Human Factors, 38, 702–715.

Sorkin, R. D. , Wightman, F. L. , Kistler, D. S. , & Elvers, G. C. (1989). An exploratory study of the use of movement-correlated cues in an auditory head-up display. Human Factors, 31, 161–166.

Wenzel, E. M. , Arruda, M. , Kistler, D. J. , & Wightman, F. L. (1993). Localization using nonindividualized head-related transfer functions. Journal of the Acoustical Society of America, 94, 111–123.

10.

Wightman, F. L. , & Kistler, D. J. (1989). Headphone simulation of free-field listening: I. Stimulus synthesis. Journal of the Acoustical Society of America, 85, 858–867.