By applying multidimensional scaling procedures and other quantitative analyses to perceptual dissimilarity judgments, we compared the perceptual structure of visual line graphs depicting simulated time series data with that of auditory displays (musical graphs) presenting the same data. Highly similar and meaningful perceptual structures were demonstrated for both auditory and visual modalities, showing that important data characteristics (function slope, shape, and level) were perceptually salient in either presentation mode. Auditory graphics may be a highly useful alternative to traditional visual graphics for a variety of data presentation applications.
Get full access to this article
View all access options for this article.
References
1.
Blattner, M. M.Greenberg, R. M. and Kamegai, M. (1990). Listening to turbulence: An example of scientific audiolization. In Proceedings of the ACM SIGCHI 90 Workshop on Multimedia and Multimodal Interface Design (pp. 1–8). New York: Association for Computing Machinery.
2.
Bly, S. (1982). Presenting information in sound. In Proceedings of the CHI 1982 Conference on Human Factors in Computer Systems (pp. 371–375). New York: Association for Computing Machinery.
3.
Carroll, J. D., and Chang, J. J. (1970). Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition. Psychometrika, 35, 238–319.
4.
Cowan, N. (1984). On short and long auditory stores. Psychological Bulletin, 96, 341–370.
5.
Flowers, J. H., and Hauer, T. A. (1992). The ear's versus the eye's potential to assess characteristics of numeric data: Are we too visuocentric?Behavior Research Methods, Instruments, and Computers, 24, 258–264.
6.
Flowers, J. H., and Hauer, T. A.(1993). “Sound” alternatives to visual graphics for exploratory data analysis. Behavior Research Methods. Instruments, and Computers, 25, 242–249.
7.
Garbin, C. P. (1988). Visual-haptic perceptual nonequivalence for shape information and its impact upon cross-modal performance. Journal of Experimental Psychology, 4, 547–553.
8.
Gaver, W. W. (1989). The SonicFinder: An interface that uses auditory icons. Human-Computer Interaction, 4, 67–94.
9.
Kendall, G. S. (1991). Visualization by ear: Auditory imagery for scientific visualization and virtual reality. Computer Music Journal, 15, 70–73.
10.
Kruskal, J. B. (1964). Nonmetric multidimensional scaling. Psychometrika, 29, 1–27
11.
Lunney, D., and Morrison, R. (1990). Auditory presentation of experimental data. Proceedings of the Society of Photo-Optical Instrumentation Engineers Conference, 1259, 140–146.
12.
Marks, L. E. (1987). On cross-modal similarity: Perceiving temporal patterns by hearing, touch, and vision. Perception and Psychophysics, 42, 250–256.
13.
McAdams, S., and Bigand, E. (1993). Thinking in sound: The cognitive psychology of human audition. New York: Oxford University Press.
14.
Scaletti, C., and Craig, A. (1991, February). Using sound extract meaning from complex data. Paper presented at the Society of Photo-Optical Instrumentation Engineers Conference, San Jose, CA.
15.
Trehub, S. E., and Trainor, L. J. (1993), Listening strategies in infancy: The roots of music and language development. In S. McAdams and E. Bigand (Eds.), Thinking in sound: The cognitive psychology of human audition (pp. 278–317). New York: Oxford University Press.
