What you see is what you hear: The importance of visual priming in music performer identification

Abstract

Visual information plays a critical role in the assessment of music performance. Audiovisual integration is well recognised in person perception, and people readily match talking faces to speaking voices. This effect exists in identifying music performers, but its strength is untested. This study investigated the importance of visual or audio priming in identifying a music performer from a line-up. Half the participants saw a target saxophonist (no sound) and then heard a line-up (no visuals) of saxophonists playing (2 to 5 saxophonists). In contrast, half the participants heard a target saxophonist (no visuals) and then saw the line-up (no sound). Participants identified the target saxophonist in visual and audio line-ups at a rate above chance, although identification accuracy decreased as the line-up number increased. Those who saw the targets identified a significantly greater number of performers from the audio line-up than those who heard the targets and identified them from a visual line-up. As the task complexity and number of distractors increased, responses remained consistent and visual priming was robust and reliable in performer identification.

Keywords

audiovisual integration auditory identification music perception music performance non-verbal communication

Get full access to this article

View all access options for this article.

References

Broughton

Stevens

(2009). Music, movement and marimba: an investigation of the role of movement and gesture in communicating musical expression to an audience. Psychology of Music, 37(2), 137–153. doi:10.1177/0305735608094511

Chartrand

J.-P.

Belin

(2006). Superior voice timbre processing in musicians. Neuroscience Letters, 405(3), 164–167.

Dahl

Friberg

(2007). Visual perception of expressiveness in musicians’ body movements. Music Perception, 24(5), 433–454.

Davidson

J. W.

(1993). Visual perception of performance manner in the movements of solo musicians. Psychology of Music, 21(2), 103–113. doi:10.1177/030573569302100201

Kamachi

Hill

Lander

Vatikiotis-Bateson

(2003). “Putting the face to the voice”: Matching identity across modality. Current Biology, 13(19), 1709–1714.

Lachs

Pisoni

D. B.

(2004). Crossmodal source identification in speech perception. Ecological Psychology, 16(3), 159–187.

Maier

Di Luca

Noppeney

(2011). Audiovisual asynchrony detection in human speech. Journal of Experimental Psychology: Human Perception and Performance, 37(1), 245–256.

Mitchell

H. F.

MacDonald

R. A. R.

(2014). Listeners as spectators? Audio-visual integration improves music performer identification. Psychology of Music, 42(1), 112–127.

Platz

Kopiez

(2013). When the first impression counts: Music performers, audience and the evaluation of stage entrance behaviour. Musicae Scientiae, 17(2), 167–197. doi:10.1177/1029864913486369

10.

Rosenblum

L. D.

Yakel

D. A.

Baseer

Panchal

Nodarse

B. C.

Niehus

R. P.

(2002). Visual speech information for face recognition. Perception & Psychophysics, 64, 220–229.

11.

Stevenage

S. V.

Hugill

A. R.

Lewis

H. G.

(2012). Integrating voice recognition into models of person perception. Journal of Cognitive Psychology, 24(4), 409–419. doi:10.1080/20445911.2011.642859

12.

Stevenage

S. V.

Neil

G. J.

Barlow

Dyson

Eaton-Brown

Parsons

(2013). The effect of distraction on face and voice recognition. Psychological Research, 77(2), 167–175. doi:10.1007/s00426–012–0450-z

13.

Thompson

M. R.

Luck

(2012). Exploring relationships between pianists’ body movements, their expressive intentions, and structural elements of the music. Musicae Scientiae, 16(1), 19–40. doi:10.1177/1029864911423457

14.

Thompson

W. F.

Graham

Russo

F. A.

(2005). Seeing music performance: Visual influences on perception and experience. Semiotica, 156(1/4), 177–201.

15.

Thompson

W. F.

Russo

Quinto

(2008). Audio-visual integration of emotional cues in song. Cognition and Emotion, 22, 1457–1470.

16.

Tsay

C.-J.

(2013). Sight over sound in the judgment of music performance. Proceedings of the National Academy of Sciences, 110(36), 14580–14585. doi:10.1073/pnas.1221454110

17.

Vines

B. W.

Krumhansl

C. L.

Wanderley

M. M.

Levitin

D. J.

(2006). Cross-modal interactions in the perception of musical performance. Cognition, 101(1), 80–113.

18.

Vuoskoski

J. K.

Thompson

M. R.

Clarke

E. F.

Spence

(2013). Crossmodal interactions in the perception of expressivity in musical performance. Attention, Perception, & Psychophysics, 1–14. doi:10.3758/s13414–013–0582–2

19.

Wapnick

Darrow

A. A.

Kovacs

Dalrymple

(1997). Effects of physical attractiveness on evaluation of vocal performance. Journal of Research in Music Education, 45(3), 470–479.

20.

Wapnick

Mazza

J. K.

Darrow

A. A.

(1998). Effects of performer attractiveness, stage behavior and dress on violin performance evaluation. Journal of Research in Music Education, 46(4), 510–521.