This paper looks at a framework for music semantics, based on the concept of embodied music cognition (Leman, 2007). The first part presents the representational viewpoint on semantics and why one should aim at transcending this. The second part deals with different types of semantics, ranging from more mental to more corporeal ones. The third part discusses issues of semantics related to embodiment. It is argued that the embodiment approach, by focusing on the role of the human body as mediator in a musical meaning formation process, may be a useful extension, and may perhaps be an alternative to the representational approach. An embodied approach to music semantics is fully embedded within an empirical and evidence-based research approach. Within this approach, methodologies from both the natural sciences and the human sciences are combined. It focuses on the human body as a mediator between mind and physical environment, thus allowing a fully multimodal approach to music semantics.
AllanbrookW. J. (1983). Rhythmic gesture in Mozart: le nozze di Figaro & Don Giovanni.Chicago, London: University of Chicago Press.
2.
BerenzweigA., LoganB., EllisD. P. W., & WhitmanB. (2004). A large-scale evaluation of acoustic and subjective music-similarity measures.Computer Music Journal, 28(2), 63–76.
3.
BerlyneD. E. (1971). Aesthetics and psychobiology: New York: Appleton, Century, Crofts.
4.
BharuchaJ. J. (1987). Music cognition and perceptual facilitation—a connectionist framework.Music Perception, 5(1), 1–30.
5.
BigandE., ParncuttR., & LerdahlF. (1996). Perception of musical tension in short chord sequences: The influence of harmonic function, sensory dissonance, horizontal motion, and musical training.Perception & Psychophysics, 58(1), 125–41.
6.
BigandE., PoulinB., TillmannB., MadurellF., & D'AdamoD. A. (2003). Sensory versus cognitive components in harmonic priming.Journal of Experimental Psychology-Human Perception and Performance, 29(1), 159–71.
7.
BroeckxJ. L. (1981). Muziek, ratio en affect: Over de wisselwerking van rationeel denken en affectief beleven bij voortbrengst en ontvangst van muziek.Antwerpen: Metropolis.
8.
CamurriA., MazzarinoB., RicchettiM., TimmersR., & volpeG. (2003). Multimodal analysis of expressive gesture in music and dance performances.Gesture-Based Communication in Human-Computer Interaction, 2915, 20–39.
9.
CamurriA., volpeG., De PoliG., & LemanM. (2005). Communicating expressiveness and affect in multimodal interactive systems.IEEE Multimedia, 12(1), 43–53.
10.
ClaytonM. R. L. (2007). Observing entrainment in music performance: video-based observational analysis of Indian musicians’ tanpura playing and beat marking.Musicæ Scientiæ, 11(1), 27–59.
11.
CokerW. (1972). Music and meaning. A theoretical introduction to musical aesthetics: New York: Free Press, London: Collier-Macmillan.
12.
CookeD. (1980). Language of music.Oxford University Press.
13.
CsikszentmihalyiM. (1990). Flow: the psychology of optimal experience.New York: Harper & Row.
14.
CummingN. (2000). The sonic self: musical subjectivity and signification.Bloomington: Indiana University Press.
15.
DamasioA. R. (2000). The feeling of what happens: body and emotion in the making of consciousness.London: W. Heinemann.
16.
De BruynL., LemanM., MoelantsD., DemeyM. (2009). Does social interaction activate music listeners? In YstadS., kronland-MartinetR., JensenK. (eds). Computer music modeling and setrieval.Berlin: Springer verlag.
17.
De BruynL., LemanM., & MoelantsD. (2008). Quantifying children's embodiment of musical rhythm in individual and group settings. ICMPC 10, 26-29 August 2008 Sapporo, Japan.
18.
DesmetF., LemanM., LesaffreM., & De BruynL. (2010). Statistical analysis of human body movement and group interactions in response to music. In FinkA., SeidelW., LausenB., UltschA. (eds). Advances in data analysis, data handling and business intelligence.Berlin, Heidelberg: Springer-Verlag.
19.
DeweppeA., LemanM., LesaffreM. (2009). Discerning user profiles and establishing usability for the interactive music applications that use embodied mediation technology. Proceedings of ESCOM 09. Jyväskylä.
20.
DrobischC. L., & PetersW. C. (1870). Mass in C arranged with an Organ or Piano accompaniment by W. C. Peters: New York.
21.
EliasN. (1937). Über den Prozess der Zivilisation: soziogenetische und psychogenetische Untersuchungen. Basel: haus zum Falken.
22.
GabrielssonA., & LindströmE. (2001). The influence of musical structure on emotional expression. In JuslinP. N., & SlobodaJ. A. (eds), Music and emotion: Theory and research (pp. 223–248). London: Oxford University Press.
23.
GallagherS. (2005). How the body shapes the mind.Oxford: Clarendon Press.
24.
GaverW. W. (1993). How do we hear in the world—explorations in ecological acoustics.Ecological Psychology, 5(4), 285–313.
25.
GaverW. W. (1993). What in the world do we hear. An ecological approach to auditory event perception.Ecological Psychology, 5(1), 1–29.
26.
GaverW. W. (1996). Situating action. Affordances for interaction: The social is material for design.Ecological Psychology, 8(2), 111–29.
27.
GibetS. (2010). Sensorimotor control of sound-producing gestures. In GodøyR.I., & LemanM. (eds), Musical gestures—sound, movement and meaning.New York: Routledge.
28.
GodøyR.I., hagaE., & JenseniusA. R. (2006). Playing “Air instruments”: Mimicry of sound-producing gestures by novices and experts.Gesture in Human-Computer Interaction and Simulation, 3881, 256–67.
29.
GodøyR.I. (2007). Geometry and Effort in Gestural Renderings of Musical Sound. In: M. S. Dias, S. Gibet, M. M. Wanderley & R. Bastos (eds), 7th International Gesture Workshop (Lisbon, PORTUGAL, 2007), 205–15.
30.
GodøyR.I. (2010). Gestural affordances affordances of musical sound. In GodøyR.I., & LemanM. (eds), Musical gestures—sound, movement and meaning.New York: Routledge.
31.
HagenE. H., & BryantG. A. (2003). Music and dance as a coalition signaling system.Human Nature-an Interdisciplinary Biosocial Perspective, 14(1), 21–51.
32.
HattenR. S. (1994). Musical meaning in Beethoven: markedness, correlation, and interpretation.Bloomington: Indiana University Press.
33.
HauserM. D., ChomskyN., & FitchW. T. (2002). The faculty of language: What is it, who has it, and how did it evolve?Science, 298(5598), 1569–79.
34.
HelmholtzH. V. (1865). Die Lehre von der Tonempfindungen als physiologische Grundlage für die Theorie der Musik.Braunschweig: Friedrich Vieweg und Sohn.
35.
HuronD. (2006). Sweet anticipation: music and the psychology of expectation.Cambridge, MA: MIT Press.
36.
ImbertyM. (1981). Les écritures du temps—sémantique psychologique de la musique.Paris: Dunod.
37.
ImbertyM. (1979). Entendre la musique: sémantique psychologique de la musique.Paris: Dunod.
38.
JackendoffR. (2009). Parallels and non parallels between language and music.Music Perception, 26(3), 195–204.
39.
JackendoffR., & LerdahlF. (1994). A grammatical parallel between music and language. In Peregrín OteroC. (ed), Noam Chomsky: Critical Assessments (pp. 725–760). London, New York: Routledge.
40.
JackendoffR., & LerdahlF. (2006). The capacity for music: What is it, and what's special about it?Cognition, 100(1), 33–72.
41.
Jacques-DalcrozeE. (1981). La musique et nous: notes sur notre double vie.Genève, Paris: Editions Slatkine.
42.
JanataP., BirkJ. L., van hornJ. D., LemanM., TillmannB., & BharuchaJ. J. (2002). The cortical topography of tonal structures underlying Western music.Science, 298(5601), 2167–70.
43.
JentschkeS., KoelschS., SallatS., & FriedericiA. D. (2008). Children with specific language impairment also show impairment of music-syntactic processing.Journal of Cognitive Neuroscience, 20(11), 1940–51.
44.
KellerP. (2008). Joint action in music performance. In MorgantiF., CarassaA., & RivaG. (eds), Enacting Intersubjectivity: a Cognitive and Social Perspective on the Study of Interaction (pp. 205–21). Amsterdam: IOS.
45.
KivyP. (2007). Music, language, and cognition and other essays in the aesthetics of music.Oxford: Clarendon Press.
46.
KnoblichG., ThorntonI.M., GrosjeanM., & ShiffrarM. (eds) (2006). Human body perception from the inside out.Oxford, New York: Oxford University Press.
47.
KoelschS. (2005). neural substrates of processing syntax and semantics in music.Current Opinion in Neurobiology, 15(2), 207–12.
48.
KoelschS., & JentschkeS. (2008). Short-term effects of processing musical syntax: An ERP study.Brain Research, 1212, 55–62.
49.
KoelschS., JentschkeS., SammlerD., & MietchenD. (2007). Untangling syntactic and sensory processing: An ERP study of music perception.Psychophysiology, 44(3), 476–90.
50.
KrumhanslC. L. (1990). Cognitive foundations of musical pitch.New York: Oxford University Press.
51.
LemanM. (1995). Music and schema theory: cognitive foundations of systematic musicology.Berlin: Springer.
52.
LemanM. (1997). The convergence paradigm, ecological modelling, and context-dependent pitch perception.Journal of New Music Research, 26(2), 133–53.
53.
LemanM. (2000). An auditory model of the role of short-term memory in probe-tone ratings.Music Perception, 17(4), 481–509.
54.
LemanM. (2007). Embodied music cognition and mediation technology.Cambridge, MA: MIT Press.
55.
LemanM., DesmetF., StynsF., van noordenL., & MoelantsD. (2009). Sharing musical expression through embodied listening: a case study based on Chinese guqin music.Music Perception, 26(3), 263–78.
56.
LemanM., AvanziniF., de CheveignéA., BigandE. (2007). The societal contexts for sound and music computing: research, education, industry, and socio-culture.Journal of New Music Research, 36(3), 149–67.
57.
LemanM. (2008). Systematic musicology at the crossroads of modern music research. In SchneiderA. (ed), Systematic and Comparative Musicology: Concepts, Methods, Findings. Hamburger Jahrbuch für Musikwissenschaft, 24, pp. 89–115. Frankfurt am Main: Peter Lang.
58.
LemanM. (2010a). Some reflections on systematic musicology as proactive science. In BaderR., neuhausC., MorgensternU. (eds). Concepts, experiments, and fieldwork: studies in systematic musicology and ethnomusicology. Hamburger Jahrbuch für Systematische Musikwissenschaft. Frankfurt am Main: Peter Lang.
59.
LemanM. (2010b). Music, gesture, and the formation of embodied meaning. In GodøyR.I., & LemanM. (eds), Musical gestures — sound, movement and meaning.New York: Routledge.
60.
LerdahlF. (2001). Tonal pitch space.New York: Oxford University Press.
61.
LerdahlF., & JackendoffR. (1983). A generative theory of tonal music.Cambridge, MA: MIT Press.
LippsT. (1903). Ästhetik: Psychologie des Schönen und der Kunst.Hamburg und Leipzig: L. Voss.
64.
LombardM., & DittonT. (1997). At the heart of it all: The concept of presenceJournal of Computer-Mediated Communication, 3(2) (jcmc.indiana.edu/vol3/issue2/lombard.html).
65.
Merleau-PontyM. (1945). Phénoménologie de la perception.Paris: Gallimard.
66.
MetzingerT. (2003). Being no one: the self-model theory of subjectivity.Cambridge, MA: MIT Press.
67.
MeyerL. B. (1956). Emotion and Meaning in Music.Chicago: University of Chicago Press.
68.
NavedaL. & LemanM. (2009). A cross-modal heuristic for periodic pattern analysis of Samba music and dance, Journal of New Music Research, 38(4), 255–83.
69.
NavedaL. & LemanM. (2008). Representation of Samba dance gestures, using a multimodal analysis approach. In RuffaldiE., and FontanaM. (eds) ENACTIVE08 — 5th International Conferrence on Enactive Interfaces (19-21 November) pp. 68–74. Pisa: Edizioni ETS.
70.
PatelA. D. (2003). Language, music, syntax and the brain.Nature Neuroscience, 6(7), 674–81.
71.
PatelA. D. (2008). Music, language, and the brain.New York Oxford: Oxford University Press.
72.
PatelA. D., IversenJ. R., WassenaarM., & HagoortP. (2008). Musical syntactic processing in agrammatic Broca's aphasia.Aphasiology, 22(7-8), 776–89.
73.
Phillips-SilverJ., & TrainorL. J. (2005). Feeling the beat: Movement influences infant rhythm perception.Science, 308(5727), 1430–30.
74.
Phillips-SilverJ., & TrainorL. J. (2007). Hearing what the body feels: Auditory encoding of rhythmic movement.Cognition, 105(3), 533–46.
75.
PrattC. C. (1952). Music as the Language of Emotion. Washington.
76.
RaffmanD. (1993). Language, music, and mind.Cambridge, MA, London: MIT Press.
77.
RizzolattiG., & CraigheroL. (2004). The mirror-neuron system.Annual Review of Neuroscience, 27, 169–92.
78.
SchaefferP. (1966). Traité des objets musicaux. Essai interdisciplines.Paris: Le Seuil.
79.
SchneiderA. (2010). Music and Gestures: a historical introduction and survey of earlier research. In GodøyR.I., & LemanM. (eds), Musical gestures—sound, movement and meaning.New York: Routledge.
80.
SteinbeisN., & KoelschS. (2008). Shared neural resources between music and language indicate semantic processing of musical tension-resolution patterns.Cerebral Cortex, 18(5), 1169–78.
81.
StumpfC. Tonpsychologie: Leipzig, 1883.
82.
TarastiE., ForsellP., & LittlefieldR. (2003). Musical semiotics revisited.Imatra: International Semiotics Institute.
83.
TillmannB., BharuchaJ. J., & BigandE. (2000). Implicit learning of tonality: A self-organizing approach.Psychological Review, 107(4), 885–913.
84.
TomaselloM. (1999). The cultural origins of human cognition.Cambridge, MA: Harvard University Press.
85.
TomaselloM. (2008). Origins of human communication.Cambridge, MA: MIT Press.
86.
TruslitA. (1938). Gestaltung und Bewegung in der Musik.Berlin-Lichterfelde: C.F. Vieweg.
87.
Van NoordenL. (2010). The functional role and bio-kinetics of basic and expressive gestures for activation and sonification? In GodøyR.I., & LemanM. (eds), Musical gestures—sound, movement and meaning.New York: Routledge.
88.
WundtW. (1896). Grundriss der Psychologie.Leipzig: Afred kröner Verlag.
89.
ZatorreR. J., ChenJ. L., & PenhuneV. B. (2007). When the brain plays music: auditory-motor interactions in music perception and production.Nature Reviews Neuroscience, 8(7), 547–58.
90.
ZatorreR. J., & KrumhanslC. L. (2002). Mental models and musical minds.Science, 298(5601), 2138–39.
