A Virtual Display System for Conveying Three-Dimensional Acoustic Information

Abstract

A three-dimensional auditory display could take advantage of intrinsic sensory abilities like localization and perceptual organization by generating dynamic, multidimensional patterns of acoustic events that convey meaning about objects in the spatial world. Applications involve any context in which the user's situational awareness is critical, particularly when visual cues are limited or absent; e.g., air traffic control or telerobotic activities in hazardous environments. Such a display would generate localized cues in a flexible and dynamic manner. Whereas this can be readily achieved with an array of real sound sources or loudspeakers, the NASA-Ames prototype maximizes flexibility and portability by synthetically generating three-dimensional sound in realtime for delivery through headphones. Psychoacoustic research suggests that perceptually-veridical localization over headphones is possible if both the direction-dependent pinna cues and the more well understood cues of interaural time and intensity are adequately synthesized. Although the realtime device is not yet complete, recent studies at the University of Wisconsin have confirmed the perceptual adequacy of the basic approach to synthesis.

Get full access to this article

View all access options for this article.

References

Blauert

(1983) Spatial Hearing: The Psychophysics of Human Sound Localization. MIT Press: Cambridge, MA.

Brooks

F.P.

(1988) Grasping reality through illusion — Interactive graphics serving science. Proc. CHI1988, ACM Conf. Hum. Fac. Comp. Sys., Washington, D.C., 1–11.

Butler

R.A.

Belendiuk

(1977) Spectral cues utilized in the localization of sound in the median sagittal plane. J. Acoust. Soc. Am., 61, 1264–1269.

Coleman

P.D.

(1962) Failure to localize the source distance of an unfamiliar sound. J. Acoust. Soc. Am., 34, 345–346.

Doll

T.J.

Gerth

J.M.

Engelman

W.R.

Folds

D.J.

(1986) Development of simulated directional audio for cockpit applications. USAF Report No. AAMRL-TR-86-014.

Furness

T.A.

(1986) The super cockpit and its human factors challenges. Proc. Hum. Fac. Soc, 1986 (1), 48–52.

Gardner

M.B.

(1968) Proximity image effect in sound localization. J. Acoust. Soc. Am., 43, 163.

Gardner

M.B.

Gardner

R.S.

(1973) Problem of localization in the median plane: Effect of pinnae cavity occlusion. J. Acoust. Soc. Am., 53, 400–408.

Oldfield

S.R.

Parker

S.P.A.

(1984) Acuity of sound localisation: A topography of auditory space. II. Pinna cues absent. Perc., 13, 601–617.

10.

Perrott

D.R.

(1982) Studies in the perception of auditory motion. In Localization of Sound: Theory and Applications, Gatehouse

R.W.

(Ed.), Amphora Press: Groton, CN, 169–193.

11.

Plenge

(1974) On the difference between localization and lateralization. J. Acoust. Soc. Am., 56, 944–951.

12.

Lord Rayleigh [Strutt, J.W.] (1907) On our perception of sound direction. Phil. Mag., 13, 214–232.

13.

Shaw

E.A.G.

(1974) The external ear. In Handbook of Sensory Physiology, Vol. V/l, Auditory System, Keldel

W.D.

Neff

W.D.

(Eds.), Springer-Verlag: New York.

14.

Sutherland

I.E.

(1968) Head-mounted three-dimensional display. Proc. Fall Joint Comp. Conf., 33, 757–764.

15.

Thurlow

W.R.

Runge

P.S.

(1967) Effect of induced head movements on localization of direction of sounds. J. Acoust. Soc. Am., 42, 480–488.