Effects of Localized Auditory Information on Visual Target Detection Performance Using a Helmet-Mounted Display

Abstract

An experiment was conducted to evaluate the effects of localized auditory information on visual target detection performance. Visual targets were presented on either a wide field-of-view dome display or a helmet-mounted display and were accompanied by either localized, nonlocalized, or no auditory information. The addition of localized auditory information resulted in significant increases in target detection performance and significant reductions in workload ratings as compared with conditions in which auditory information was either nonlocalized or absent. Qualitative and quantitative analyses of participants′ head motions revealed that the addition of localized auditory information resulted in extremely efficient and consistent search strategies. Implications for the development and design of multisensory virtual environments are discussed. Actual or potential applications of this research include the use of spatial auditory displays to augment visual information presented in helmet-mounted displays, thereby leading to increases in performance efficiency, reductions in physical and mental workload, and enhanced spatial awareness of objects in the environment.

Get full access to this article

View all access options for this article.

References

Barfield, W. , Cohen, M. , & Rosenberg, C. (1997). Visual and auditory localization as a function of azimuth and elevation. International Journal of Aviation Psychology, 7, 123–138.

Beal, C. , & Sweetman, B. (1994). Helmet-mounted displays: Are we jumping the gun? International Defense Review, 9, 69–75.

Begault, D. R. , & Pittman, M. T. (1996). Three-dimensional audio versus head-down traffic alert and collision avoidance system displays. International Journal of Aviation Psychology, 6, 79–93.

Bronkhorst, A. W. , Veltman, J. A. H. , & Breda, L., van. (1996). Application of a three-dimensional auditory display in a flight task. Human Factors, 38, 23–33.

Furness, T. A. (1986). The super cockpit and its human factors challenges. In Proceedings of the Human Factors Society 30th Annual Meeting (pp. 48–52). Santa Monica, CA: Human Factors and Ergonomics Society.

Hettinger, L. J. , Nelson, W. T. , & Haas, M. W. (1996). Target detection performance in helmet-mounted and conventional dome displays. International Journal of Aviation Psychology, 6, 321–334.

McKinley, R. L. , Ericson, M. A. , & D'Angelo, W. R. (1994, May). Three-dimensional auditory displays: Development, applications, and performance. Aviation, Space, and Environmental Medicine, 65, 31–38.

Perrott, D. R. , Cisneros, J. , McKinley, R. L. , & D'Angelo, W. R. (1996). Aurally aided visual search under virtual and free field listening conditions. Human Factors, 38, 702–715.

Perrott, D. R. , Sadralodabai, T. , & Saberi, K. (1991). Aurally aided visual search in the central visual field: Effects of visual load and visual enhancement of the target. Human Factors, 33, 389–400.

10.

Sorkin, R. D. , Wightman, F. L. , Kistler, D. S. , & Elvers, G. C. (1989). An exploratory study of the use of movement-correlated cues in an auditory head-up display. Human Factors, 31, 161–166.

11.

Stinnett, T. A. (1989). Human factors in the super cockpit. In R. Jensen (Ed.), Aviation psychology (pp. 1–37). Brookfield, VT: Gower Publishing.

12.

Wenzel, E. M. (1992). Localization in virtual acoustic displays. Presence, 1, 80–106.

13.

Wightman, F. L. , & Kistler, D. J. (1989). Headphone simulation of free-field listening: II. Psychophysical validation. Journal of the Acoustical Society of America, 82, 868–878.