Size Matters: The Role of Auditory and Visual Scale in the Identification of Unfamiliar Voices

Abstract

Augmenting spatialized audio environments with visual depictions of voice locations has been shown to increase voice-identification performance. How the relative scale of mixed audio/visual interfaces affects this benefit, however, is not well understood. In this experiment, we compared the accuracy, response time, and confidence of 36 participants in a spatialized voice-identification task using three visual scale conditions viewed from a common distance: a 2-inch display, a 10-inch display, and 25.5-inch display. Each display was investigated using eight spatialized voices presented in two audio scale conditions: voices distributed across the entire interaural axis or across only the central half. Results showed significantly greater voice-identification accuracy for the larger audio scale and the two largest visual scales, and increased response time for the smallest visual scale. Confidence in task performance remained unchanged across conditions. These results indicate large-scale audio/visual interfaces may best capitalize upon the perceptual benefits of visually representing spatialized voice locations.

Get full access to this article

View all access options for this article.

References

Abouchacra

(2001). Binaural Helmet: Improving speech recognition in noise with spatialized sound. Human Factors, 43 (4) 584.

Baldis

(2001). Effects of spatial audio on memory, comprehension, and preference during desktop conferences. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Vol. 3, 2001, 166–173.

Bolia

R. S.

Nelson

W.T.

Ericson

M.A.

Simpson

B. D.

(2000). A speech corpus for multitalker communication research. J. Acoust. Soc. Am., 107 (2), 1065–66.

Bolia

(2001). Asymmetric performance in the cocktail party effect: Implications for the design of Spatial Audio Displays. Human Factors, 43 (2) 208.

Drullman

Bronkhorst

A.W.

(2000). Multichannel speech intelligibility and talker recognition using monaural, binaural, and three-dimensional auditory presentation. J. Acoust. Soc. Am., 107(4), 2224–2235.

Ericson

M.A.

McKinley

R. L.

(1997). The intelligibility of multiple talkers separated spatially in noise. in Robert

Anderson

Timothy R.

(Eds.) Binaural and Spatial Hearing in Real and Virtual Environments, Gilkey, NJ, Lawrence Erlbaum Associates, 701–724.

Kilgore

R. M.

Chignell

Smith

P.W.

(2003). Spatialized audioconferencing: what are the benefits? Proceedings of the 2003 Centre for Advanced Studies Conference on Collaborative Research, 111–120.

Kilgore

R.M.

Chignell

(2005). Simple visualizations enhance speaker identification when listening to spatialized voices. Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting..

MacDonald

(2002). Intelligibility of speech in a virtual 3-D environment. Human Factors, 44(2), 272.