Do speech and music understanding share common neural mechanisms? Here, brain bioelectrical activity was recorded in healthy participants listening to music obtained by digitally transforming speech into viola music. Sentences originally had a positive or negative affective prosody. The aim was to investigate if the emotional content of music was processed similarly to the affective prosody of speech. EEG was recorded from 128 electrodes in 20 healthy students. Participants had to detect rare neutral piano sounds while ignoring viola melodies. Negative affective valence of stimuli increased the amplitude of frontal P300 and N400 components of ERPs, while positive valence enhanced a late inferior frontal positivity. Similar markers were previously found for the processing of positive versus negative music, vocalizations, and speech. Source reconstruction showed that negative music activated the right superior temporal gyrus and cingulate cortex, while positive music activated the left middle and inferior temporal gyrus and the inferior frontal cortex. An integrated model is proposed of a possible common network for processing the emotional content of music, vocalizations, and speech, which might explain some universal and relatively innate brain reaction to music.
AbramsD. A.BhataraA.RyaliS.BalabanE.LevitinD. J.MenonV. (2011). Decoding temporal structure in music and speech relies on shared brain resources but elicits different fine-scale spatial patterns. Cerebral Cortex, 21(7), 1507–1518.
2.
AltenmüllerE.SchürmannK.LimV.ParlitzD. (2002). Hits to the left—Flops to the right. Different emotions during music listening are reflected in cortical lateralisation patterns. Neuropsychologia, 40, 1017–1025.
3.
AltenmüllerE.SiggelS.MohammadiB.SamiiA.MünteT. F. (2014). Play it again, Sam: Brain correlates of emotional music recognition. Frontiers in Psychology, 5, Article 114.
4.
AubéW. A.Angulo-PerkinsI.Peretz ConchaL.ArmonyJ. L. (2015). Fear across the senses: Brain responses to music, vocalizations and facial expressions. Social Cognitive and Affective Neuroscience, 10, 399–407.
5.
BanseR.SchererK. R. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70(3), 614–636.
6.
BeaucousinV.LacheretA.TurbelinM. R.MorelM.MazoyerB.Tzourio-MazoyerN. (2006). FMRI study of emotional speech comprehension. Cerebral Cortex, 17(2), 339–352.
7.
BelinP.FecteauS.CharestI.NicastroN.HauserM. D.ArmonyJ. L. (2008). Human cerebral response to animal affective vocalizations. Proceedings of the Royal Society B: Biological Sciences, 275(1634), 473–481.
8.
BogertB.Numminen-KonttiT.GoldB.SamsM.NumminenJ.BurunatI.LampinenJ.BratticoE. (2016). Hidden sources of joy, fear, and sadness: Explicit versus implicit neural processing of musical emotions. Neuropsychologia, 89, 393–402.
9.
CanliT.DesmondJ. E.ZhaoZ.GloverG.GabrieliJ. D. E. (1998). Hemispheric asymmetry for emotional stimuli detected with fMRI. NeuroReport, 9(14), 3233–3239.
10.
CataniM.Dell’acquaF.Thiebaut de SchottenM. (2013). A revised limbic system model for memory, emotion and behaviour. Neuroscience & Biobehavioral Reviews, 37(8), 1724–1737.
11.
CookN. D.FujisawaT. X.TakamiK. (2006). Evaluation of the affective valence of speech using pitch substructure. IEEE Transactions on Audio, Speech, and Language Processing, 14(1), 142–151.
12.
Council for International Organizations of Medical Sciences (CIOMS). (2016). International ethical guidelines for health-related research involving humans. WHO.
13.
Dalla BellaS.PeretzI.RousseauL.GosselinN. (2001). A developmental study of the affective value of tempo and mode in music. Cognition, 80(3), 1–10.
14.
DavidsonR. J. (1992). Anterior cerebral asymmetry and the nature of emotion. Brain and Cognition, 20(1), 125–151.
15.
EscoffierN.ZhongJ.SchirmerA. (2013). Emotional expressions in voice and music: Same code, same effect?Human Brain Mapping, 34, 1796–1810.
16.
EthoferT.AndersS.ErbM.HerbertC.WiethoffS.KisslerJ.GroddW.WildgruberD. (2006). Cerebral pathways in processing of affective prosody: A dynamic causal modeling study. NeuroImage, 30(2), 580–587.
17.
FlomR.GentileD. A.PickA. D. (2008). Infants’ discrimination of happy and sad music. Infant Behavior and Development, 31(4), 716–728.
18.
Flores-GutiérrezE. O.DíazJ. L.BarriosF. A.Favila-HumaraR.GuevaraM. Á.del Río-PortillaY.Corsi-CabreraM. (2007). Metabolic and electric brain patterns during pleasant and unpleasant emotions induced by music masterpieces. International Journal of Psychophysiology, 65(1), 69–84.
19.
FriedericiA. D. (2011). The brain basis of language processing: From structure to function. Physiological Reviews, 91(4), 1357–1392.
20.
FritzT.JentschkeS.GosselinN.SammlerD.PeretzI.TurnerR.KoelschS. (2009). Universal recognition of three basic emotions in music. Current Biology, 19(7), 573–576.
21.
JuslinP. N.LaukkaP. (2003). Emotional expression in speech and music: Evidence of cross-modal similarities. Annals of the New York Academy of Sciences, 1000, 279–282.
22.
KhalfaS.GuyeM.PeretzI.ChaponF.GirardN.ChauvelP.Liégeois-ChauvelC. (2008). Evidence of lateralized anteromedial temporal structures involvement in musical emotion processing. Neuropsychologia, 46(10), 2485–2493.
23.
KoelschS.FritzT.CramonD. Y. V.MüllerK.FriedericiA. D. (2006). Investigating emotion with music: An fMRI study. Human Brain Mapping, 27(3), 239–250.
24.
KoelschS.RohrmeierM.TorrecusoR.JentschkeS. (2013). Processing of hierarchical syntactic structure in music. Proceedings of National Academy of Sciences, 110(38), 15443–15448.
25.
KotzS. A.KalberlahC.BahlmannJ.FriedericiA. D.HaynesJ. D. (2013). Predicting vocal emotion expressions from the human brain. Human Brain Mapping, 34(8), 1971–1981.
26.
KotzS. A.MeyerM.AlterK.BessonM.von CramonD. Y.FriedericiA. D. (2003). On the lateralization of emotional prosody: An event-related functional MR investigation. Brain & Language, 86, 366–376.
27.
PankseppJ.BernatzkyG. (2002). Emotional sounds and the brain: The neuro-affective foundations of musical appreciation. Behavioural Processes, 60(2), 133–155.
28.
PaquetteS.RigoulotS.GrunewaldK.LehmannA. (2020). Temporal Decoding of Vocal and Musical Emotions: Same Code, Different Time course?Brain Research, 1741, Article 146887.
29.
PaquetteS.TakerkartS.SagetS.PeretzI.BelinP. (2018). Cross-classification of musical and vocal emotions in the auditory cortex. Annals of the New York Academy of Sciences, 1423, 329–337.
30.
PaulmannS.KotzS. A. (2008). An ERP investigation on the temporal dynamics of emotional prosody and emotional semantics in pseudo- and lexical-sentence context. Brain & Language, 105(1), 59–69.
31.
PaulmannS.SeifertS.KotzS. A. (2010). Orbito-frontal lesions cause impairment during late but not early emotional prosodic processing. Social Neuroscience, 5(1), 59–75.
32.
ProverbioA. M.De BenedettoF. (2018). Auditory enhancement of visual memory encoding is driven by emotional content of the auditory material and mediated by superior frontal cortex. Biological Psychology, 132, 164–175.
33.
ProverbioA. M.De BenedettoF.GuazzoneM. (2020). Shared neural mechanisms for processing emotions in music and vocalizations. European Journal of Neuroscience, 51(9), 1987–2007.
34.
ProverbioA. M.OrlandiA.PisanuF. (2016). Brain processing of consonance/dissonance in musicians and controls: A hemispheric asymmetry revisited. European Journal of Neuroscience, 44(6), 2340–2356.
35.
ProverbioA. M.SantoniS.AdorniR. (2020). ERP makers of valence coding in emotional speech processing. iScience, 23, Article 100933.
36.
PutkinenV.MakkonenT.EerolaT. (2017). Music-induced positive mood broadens the scope of auditory attention. Social Cognitive and Affective Neuroscience, 12(7), 1159–1168.
37.
RogenmoserL.ZollingerN.ElmerS.JänckeL. (2016). Independent component processes underlying emotions during natural music listening. Social Cognitive and Affective Neuroscience, 11(9), 1428–1439.
38.
SachsM. E.EllisR. J.SchlaugG.LouiP. (2016). Brain connectivity reflects human aesthetic responses to music. Social Cognitive and Affective Neuroscience, 11(6), 884–891.
39.
SachsM. E.HabibiA.DamasioA.KaplanJ. T. (2018). Decoding the neural signatures of emotions expressed through sound. NeuroImage, 174, 1–10.
40.
SchapkinS. A.GusevA. N.KuhlJ. (2000). Categorization of unilaterally presented emotional words: An ERP analysis. Acta Neurobiologiae Experimentalis, 60, 17–28.
41.
SchirmerA.KotzS. A. (2006). Beyond the right hemisphere: Brain mechanisms mediating vocal emotional processing. Trends in Cognitive Sciences, 10(1), 24–30.
42.
SchmidtL. A.TrainorL. J. (2001). Frontal brain electrical activity (EEG) distinguishes valence and intensity of musical emotions. Cognition & Emotion, 15(4), 487–500.
43.
SchubertE. (2019). Which nonvocal musical instrument sounds like the human voice? An empirical investigation. Empirical Studies of the Arts, 37, 103–192.
44.
SteinbeisN.KoelschS. (2008). Comparing the processing of music and language meaning using EEG and FMRI provides evidence for similar and distinct neural representations. PLOS ONE, 3(5), Article e2226.
45.
VassalF.SchneiderF.BoutetC.JeanB.SontheimerA.LemaireJ. J. (2016). Combined DTI Tractography and Functional MRI Study of the Language Connectome in Healthy Volunteers: Extensive Mapping of White Matter Fascicles and Cortical Activations. PLOS ONE, 11(3), Article e0152614.
46.
WildgruberD.RieckerA.HertrichI.ErbM.GroddW.EthoferT.AckermannH. (2005). Identification of emotional intonation evaluated by fMRI. NeuroImage, 24(4), 1233–1241.
47.
ZatorreR. J.BelinP.PenhuneV. B. (2002). Structure and function of auditory cortex: Music and speech. Trends in Cognitive Sciences, 6(1), 37–46.
48.
ZhangD.ZhouY.YuanJ. (2018). Speech prosodies of different emotional categories activate different brain regions in adult cortex: An fNIRS study. Scientific Reports, 8(1), Article 218.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
