In order to enhance fidelity and reduce confusion through compensation of vision, it is necessary to investigate three-dimensional acoustic simulation over headphones based on virtual environments. Localization cues that can provide positional infor mation such as head-related transfer function, in teraural time difference, and interaural intensity difference, play an important role in three-dimen sional acoustic simulation. Audio signal processing based on wavelet transform and Huffman encoding reduces data storage and transmission to meet lower bit rate requirements in interactive environments. Visual and aural fusion through a synchronic con trol mechanism make acoustic simulation environ ments closer to the natural world to achieve the goal of three-dimensional acoustic simulation based on virtual environments. Psychoacoustic tests of acous tic simulation based on virtual environments dem onstrate that this simulation method is efficient and reliable.
Wang, Z. and Ben-Arie, J. "Conveying Visual Information with Spatial Auditory Patterns." IEEE Transactions on Speech and Audio Processing, Vol. 4, No. 6, pp 446-455, 1996.
2.
Makous, J.C. and Middlebrooks , J.C. "Two Dimensional Sound Localization by Human Listeners." Journal of the Acoustical Society of America, Vol. 87, No. 5, May 1990.
3.
Wenzel, E.M. , Wightman, F.L. and Kistler, D.J. "Realtime Digital Synthesis of Localized Auditory Cues Over Headphones ." IEEE Workshop Applications Signal Processing Audio Acoustics, New York , Oct. 1991 .
4.
Middlebrook, J.C. and Green, D.H. "Sound Localization by Human Listeners." Annu. Rev. Psychol., Vol. 42, pp 135-149, 1991.
5.
Durlach, N.I. , Shinn-Cunningham , B.G. and Held, R.M. "Supernormal Auditory Localization: I. General Background." Presence, Vol. 2, No. 2, pp 89-103, 1993.
6.
Rabinowitz, W.M., Maxwell, J., Shao , Y. and Wei, M. "Sound Localization Cues for a Magnified Head: Implications from Sound Diffraction about a Rigid Sphere." Presence, Vol. 2, No. 2, pp 125- 129, 1993.
7.
Latta, J.N. and Oberg, D.J. "A Conceptual Virtual Reality Model." IEEE Computer Graphics and Application, pp 23-29, January 1994.
8.
Zhihe, Y. and Jianchao, Z.Virtual Reality Technology: Generating Real World by Computer. Dalian University of Science and Technology Press, 1996 .
9.
Mitchell, A.R. and Rosen, S., et al. "Determinants of Immersivity in Virtual Reality: Graphics vs. Action." Computer Graphics Proceedings, Annual Conference Series, pg 496, 1994.
10.
Tewfik, A.H. , Sinha, D. and Jorgensen, P. "On the Optimal Choice of a Wavelet for Signal Representation." IEEE Transactions on Information Theory , Vol. 38, pp 747-765, 1992.
11.
Blauert, J.Spatial Hearing: The Psychophysics of Human Sound Localization. MIT Press, Cambridge, MA, 1983.
12.
Nandy, D. and Ben-Arie, J. "A Comparison of Auditory Localization Models." IEEE Proceedings of the 12th LAPR International Conference on Computer Vision and Image Processing, pp 123-127, 1994.
13.
Ericson, M., D'Angelo, W., et al. "Application of Virtual Audio." Proceedings of the IEEE NAECON, pp 604-611, 1993.
14.
Zahorik, P., Wightman, F.L. and Kistler, D.J. "On the Discriminability of Virtual and Real Sound Sources." Proceedings of the 1995 Workshop on Application of Signal Processing to Audio and Accoustics, pp 76-79, 1995.
15.
Duda, R.O. "Modeling Head Related Transfer Functions." IEEE Conference Record of the 27th Asilomar Conference on Signals, Systems and Computers, pp 996-1000, 1993.
16.
Wightman, F.L. and Kistler, D.J. "Headphone Simulation of Free-field Listening. I: Stimulus Synthesis." Journal of the Acoustical Society of America, Vol. 85, No. 2, pp 858-867, 1989.
17.
Wenzel, E.M. et al. "Location Using Non-Individualized HRTFs ." Journal of the Acoustical Society of America, pp 111-123, 1993.
18.
Mackenzie, J., Huopaniemi, J. and Valimaki, V. "Low-Order Modeling of Head Related Transfer Functions Using Balanced Model Truncation ." IEEE Signal Processing Letter, Vol. 4, No. 2, pp 39-41, 1997.
19.
Kistler, D.J. and Wightman, F.L. "A Model of HRTFs Based on Principal Components Analysis and Minimum-phase Reconstruction." Journal of the Acoustical Society of America, pp 1637-1647, 1991.
20.
Cheung, N.-M. and Trautmann, S. "Genetic Algorithm Approach to Head Related Transfer Function Modeling in 3-Dimensional Sound System." IEEE First Workshop on Multimedia Signal Processing, pp 83-88, 1997.
21.
Neti, C., Young, E.D. and Schneider, M.H. "Neural Network Models of Sound Localization Based on Directional Filtering by the Pinna." Journal of the Acoustical Society of America , pp 3140-3156, 1992.
22.
Blommer, M.A. and Wakefield , G.H. "Pole-Zero Approximations for HRTF Using a Logarithmic Error Criterion." IEEE Transactions on Speech and Audio Processing, Vol. 5, No. 5, pp 278-287, 1997.
23.
Wenzel, E.M. "The Relative Contribution of Interaural Time and Magnitude Cues to Dynamic Sound Localization." Proceedings of 1995 Workshop on Application of Signal Processing to Audio and Acoustics, pp 80-83, 1995.
24.
Wightman, F.L., Kistler, D.J. and Anderson, K. "Reassessment of the Role of Head Movement in Human Sound Localization." Journal of the Acoustical Society of America, pp 3003-3004, 1994 .
25.
Gardner, W.G. and Martin, K.D. "HRTF Measurements of a KEMAR." Journal of the Acoustical Society of America, Vol. 97, No. 6, pp 3907-3908, 1995.
26.
Sodagar, I. and Nayebi, K. "Time-Varying Filter Banks and Wavelets." IEEE Transactions on Signal Processing, Vol. 41, No. 12, pp 2983-2996, 1993 .
27.
Daubechies, I. "The Wavelet Transforms, Time-frequency Localization and Signal Analysis." IEEE Transactions on Information Theory , Vol. 36, No. 9, pp 961-1005, 1990.
28.
Dauvechies, I. "Orthonormal Bases of Compactly Supported Wavelets." Comm. Pure Appl. Math, Vol. 41, No. 7, pp 909-996, 1988.
29.
Chui, C.K.An Introduction to Wavelets. Academic Press, New York, 1992.
30.
Xia, X.G. and Zhang, Z. "On Sampling Theorem, Wavelets, and Wavelet Transform." IEEE Transactions on Signal Processing , Vol. 41, No. 12, pp 3524-3535, 1992 .
31.
Hlawatsch, H. and Boudreaux-Bartels , G.F. "Linear and Quadratic Time-Frequency Signal Representations." IEEE Signal Processing Magazine, No. 4, pp 21-67, 1992.
32.
Mallat, S.G. "A Theory for Multiresolution Signal Decomposition : The Wavelet Representation." IEEE Trans. Pattern Anal. Machine Intell., Vol. 11, pp 674-693, 1989.
33.
Mallat, S.G. "Multifrequency Channel Decomposition of Images and Wavelet Models." IEEE Trans. Acoust. Speech, Signal Processing , Vol. 37, pp 2091-2110, 1989.
34.
Lynch, T.J.Data Compression: Techniques and Applications. Lifetime Learning Publications, 1984.
35.
Takala, T. and Hahn, J. "Sound Rendering." Computer Graphics, Vol. 26, No. 2, pp 211-219, 1992.
36.
Fouad, H. and Hahn, J.K. "A Framework for Integrating Sound into Virtual Environment Interfaces." SPIE, Vol. 2653, pp 285-291, 1996.
37.
Azuma, R. and Bishop, G. "A Frequency-Domain Analysis of Head-Motion Prediction." Computer Graphics Proceedings of SIGGRAPH '95, Los Angeles, August 6-11, 1995, pp 401-408, 1995.
Emura, S. and Tachi, S. "Compensation of Time Lag Between Actual and Virtual Space by Multi-Sensor Integration." Proceedings of the 1994 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, pp 463-469, 1994.
40.
Zikan, K. , Curtis, W.D., et al. "A Note on Dynamics of Human Head Motions and on Predictive Filtering of Head-set Orientations." SPIE, Vol. 2351.
