To examine the impact of music as a cross-modal prime on facial emotion recognition ability in autistic children, this study compares the priming effect of music with that of faces as an intramodal prime and nonverbal sounds as the same cross-modal prime. The response time and accuracy of facial emotion recognition (happy and sad) were compared among 21 neurotypical children and 17 autistic children under various priming stimuli. A data analysis revealed that autistic children exhibited worse recognition of facial emotional expressions and demonstrated longer reaction time than neurotypical children. Unlike the other two stimuli (facial expressions and nonverbal sounds), music as a cross-modal prime resulted in slightly higher response accuracy for emotionally congruent conditions compared with emotionally incongruent conditions among autistic children. Furthermore, reaction time was significantly prolonged under emotionally congruent conditions than under emotionally incongruent conditions. This suggests that autistic children demonstrate a greater propensity to allocate additional time to improve the accuracy of their judgments under congruent conditions compared with incongruent conditions. Therefore, music intervention has significant potential for supporting autistic children to empathize with faces by playing emotionally congruent music and improving their facial emotion recognition abilities.
AltenmullerE.SchurmannK.LimV. K.ParlitzD. (2002). Hits to the left, flops to the right: Different emotions during listening to music are reflected in cortical lateralisation patterns. Neuropsychologia, 40(13), 2242–2256. https://doi.org/10.1016/s0028-3932(02)00107-0
2.
American Psychiatric Association, DSM-5 Task Force. (2013). Diagnostic and statistical manual of mental disorders: DSM-5™ (5th ed.). American Psychiatric Publishing, Inc. https://doi.org/10.1176/appi.books.9780890425596
3.
ApplewhiteB.CankayaZ.HeiderscheitA.HimmerichH. (2022). A systematic review of scientific studies on the effects of music in people with or at risk for autism spectrum disorder. International Journal of Environmental Research and Public Health, 19(9), 5150. https://doi.org/10.3390/ijerph19095150
4.
ArkushL.Smith-CollinsA. P. R.FiorentiniC.SkuseD. H. (2013). Recognition of face and non-face stimuli in autistic spectrum disorder. Autism Research, 6(6), 550–560. https://doi.org/10.1002/aur.1318
5.
Bai LuM.HuiH.Yu-XiaYue-JiaL. (2005). The development of native Chinese affective picture system – A pretest in 46 college students. Chinese Mental Health Journal, 19(11), 719–722.
6.
BalE.HardenE.LambD.Van HeckeA. V.DenverJ. W.PorgesS. W. (2010). Emotion recognition in children with autism spectrum disorders: Relations to eye gaze and autonomic state. Journal of Autism and Developmental Disorders, 40(3), 358–370. https://doi.org/10.1007/s10803-009-0884-3
7.
Ben-YosefD.AnakiD.GolanO. (2017). Context processing in adolescents with autism spectrum disorder: How complex could it be?Autism Research, 10(3), 520–530. https://doi.org/10.1002/aur.1676
8.
BonnelA.MottronL.PeretzI.TrudelM.GallunE.BonnelA.-M. (2003). Enhanced pitch sensitivity in individuals with autism: A signal detection analysis. Journal of Cognitive Neuroscience, 15(2), 226–235. https://doi.org/10.1162/089892903321208169
9.
BrosnanM.AshwinC.LewtonM. (2017). Brief report: Intuitive and reflective reasoning in autism spectrum disorder. Journal of Autism and Developmental Disorders, 47(8), 2595–2601. https://doi.org/10.1007/s10803-017-3131-3
10.
BrosnanM.ChapmanE.AshwinC. (2014). Adolescents with autism spectrum disorder show a circumspect reasoning bias rather than “jumping-to-conclusions.”Journal of Autism and Developmental Disorders, 44(3), 513–520. https://doi.org/10.1007/s10803-013-1897-5
11.
CariaA.VenutiP.de FalcoS. (2011). Functional and dysfunctional brain circuits underlying emotional processing of music in autism spectrum disorders. Cerebral Cortex, 21(12), 2838–2849. https://doi.org/10.1093/cercor/bhr084
12.
CarrollN. C.YoungA. W. (2005). Priming of emotion recognition. The Quarterly Journal of Experimental Psychology Section A, 58(7), 1173–1197. https://doi.org/10.1080/02724980443000539
13.
CheangR. T.SkjevlingM.BlakemoreA. I.KumariV.PuzzoI. (2024). Do you feel me? Autism, empathic accuracy and the double empathy problem. Autism : The International Journal of Research and Practice, 1546823200. https://doi:10.1177/13623613241252320
14.
CorbettB. A.ConstantineL. J. (2006). Autism and attention deficit hyperactivity disorder: Assessing Attention and response control with the integrated visual and auditory continuous performance test. Child Neuropsychology, 12(4-5), 335–348. https://doi.org/10.1080/09297040500350938
15.
DănciulescuT.ZahariaA. (2023). Piano with a twist: A pilot study exploring the preliminary effects of a piano therapy program for children with autism spectrum disorder. The Arts in Psychotherapy, 82, 101987. https://doi.org/10.1016/j.aip.2022.101987
16.
DavidsonD.HilvertE.MisiunaiteI.KerbyK.GiordanoM. (2019). Recognition of facial emotions on human and canine faces in children with and without autism spectrum disorders. Motivation and Emotion, 43(1), 191–202. https://doi.org/10.1007/s11031-018-9736-9
17.
Fridenson-HayoS.BerggrenS.LassalleA.TalS.PigatD.BölteS.Baron-CohenS.GolanO. (2016). Basic and complex emotion recognition in children with autism: Cross-cultural findings. Molecular Autism, 7(1), 52. https://doi.org/10.1186/s13229-016-0113-9
18.
GebauerL.SkewesJ.WestphaelG.HeatonP.VuustP. (2014). Intact brain processing of musical emotions in autism spectrum disorder, but more cognitive load and arousal in happy vs. sad music. Frontiers in Neuroscience, 8, Article 192. https://doi.org/10.3389/fnins.2014.00192
19.
GeorgopoulosM. A.BrewerN.LucasC. A.YoungR. L. (2022). Speed and accuracy of emotion recognition in autistic adults: The role of stimulus type, response format, and emotion. Autism Research, 15(9), 1686–1697. https://doi.org/10.1002/aur.2713
20.
GolanO.GordonI.FichmanK.KeinanG. (2018). Specific patterns of emotion recognition from faces in children with ASD: Results of a cross-modal matching paradigm. Journal of Autism and Developmental Disorders, 48(3), 844–852. https://doi.org/10.1007/s10803-017-3389-5
21.
HallG. B. C.SzechtmanH.NahmiasC. (2003). Enhanced salience and emotion recognition in autism: A PET study. American Journal of Psychiatry, 160(8), 1439–1441. https://doi.org/10.1176/appi.ajp.160.8.1439
22.
HeatonP. (2003). Pitch memory, labelling and disembedding in autism. Journal of Child Psychology and Psychiatry, 44(4), 543–551. https://doi.org/10.1111/1469-7610.00143
23.
HobsonR. P. (1986). The autistic child’s appraisal of expressions of emotion: A further study. Journal of Child Psychology and Psychiatry, 27(5), 671–680. https://doi.org/10.1111/j.1469-7610.1986.tb00191.x
24.
JuslinP. N. (2013). From everyday emotions to aesthetic emotions: Towards a unified theory of musical emotions. Physics of Life Reviews, 10(3), 235–266. https://doi.org/10.1016/j.plrev.2013.05.008
25.
KamiyamaK. S.AblaD.IwanagaK.OkanoyaK. (2013). Interaction between musical emotion and facial expression as measured by event-related potentials. Neuropsychologia, 51(3), 500–505. https://doi.org/10.1016/j.neuropsychologia.2012.11.031
26.
KatagiriJ. (2009). The effect of background music and song texts on the emotional understanding of children with autism. Journal of Music Therapy, 46(1), 15–31. https://doi.org/10.1093/jmt/46.1.15
27.
KrasilevaK. E.SandersS. J.BalV. H. (2017). Peabody picture vocabulary test: Proxy for verbal IQ in genetic studies of autism spectrum disorder. Journal of Autism and Developmental Disorders, 47(4), 1073–1085. https://doi.org/10.1007/s10803-017-3030-7
28.
LauraS. B. (2016). The influence of music on facial emotion recognition in children with autism spectrum disorder and neurotypical children. Journal of Music Therapy, 54(1), 55–79.
29.
LeungF. Y. N.SinJ.DawsonC.OngJ. H.ZhaoC.VeićA.LiuF. (2022). Emotion recognition across visual and auditory modalities in autism spectrum disorder: A systematic review and meta-analysis. Developmental Review, 63, 101000. https://doi.org/10.1016/j.dr.2021.101000
30.
LeungF. Y. N.StojanovikV.MicaiM.JiangC.LiuF. (2023). Emotion recognition in autism spectrum disorder across age groups: A cross-sectional investigation of various visual and auditory communicative domains. Autism Research, 16(4), 783–801. https://doi.org/10.1002/aur.2896
31.
LiJ.DengS. W. (2023). Facilitation and interference effects of the multisensory context on learning: A systematic review and meta-analysis. Psychological Research, 87(5), 1334–1352. https://doi.org/10.1007/s00426-022-01733-4
32.
LiuX.ShiH.LiuY.YuanH.ZhengM. (2021). Mindfulness meditation improves musical aesthetic emotion processing in young adults. International Journal of Environmental Research and Public Health, 18(24), 13045. https://doi.org/10.3390/ijerph182413045
LozierL. M.VanmeterJ. W.MarshA. A. (2014). Impairments in facial affect recognition associated with autism spectrum disorders: A meta-analysis. Development and Psychopathology, 26(4 pt. 1), 933–945. https://doi.org/10.1017/S0954579414000479
35.
MatsudaS.YamamotoJ. (2015). Intramodal and cross-modal matching of emotional expression in young children with autism spectrum disorders. Research in Autism Spectrum Disorders, 10, 109–115. https://doi.org/10.1016/j.rasd.2014.11.010
36.
MilshteinD.HochmanS.HenikA. (2020). Do you feel like me or not? This is the question: Manipulation of emotional imagery modulates affective priming. Consciousness and Cognition, 85, Article 103026. https://doi.org/10.1016/j.concog.2020.103026
Molnar-SzakacsI.HeatonP. (2012). Music: A unique window into the world of autism. Annals of the New York Academy of Sciences, 1252(1), 318–324. https://doi.org/10.1111/j.1749-6632.2012.06465.x
39.
MutrejaR.CraigC.O’BoyleM. W. (2015). Attentional network deficits in children with autism spectrum disorder. Developmental Neurorehabilitation, 19(6), 389–397. https://doi.org/10.3109/17518423.2015.1017663
40.
ObermanL. M.RamachandranV. S. (2008). Preliminary evidence for deficits in multisensory integration in autism spectrum disorders: The mirror neuron hypothesis. Society for Neuroscience, 3(3–4), 348–355. https://doi.org/10.1080/17470910701563681
OzonoffS.PenningtonB. F.RogersS. J. (1990). Are there emotion perception deficits in young autistic children?Journal of Child Psychology and Psychiatry, 31(3), 343–361. https://doi.org/10.1111/j.1469-7610.1990.tb01574.x
43.
PaolizziE.BertaminiG.BentenutoA.VenutiP. (2022). Interpersonal synchrony: Interaction variables and gender differences in preschoolers with ASD [brief research report]. Frontiers in Psychiatry, 13, Article 1009935. https://doi.org/10.3389/fpsyt.2022.1009935
44.
PaterM.SpreenM.van YperenT. (2021). The developmental progress in social behavior of children with autism spectrum disorder getting music therapy. A multiple case study. Children and Youth Services Review, 120, 105767. https://doi.org/10.1016/j.childyouth.2020.105767
45.
PeretzI.GagnonL.BouchardB. (1998). Music and emotion: Perceptual determinants, immediacy, and isolation after brain damage. Cognition, 68(2), 111.
46.
PiggotJ.KwonH.MobbsD.BlaseyC.LotspeichL.MenonV.BookheimerS.ReissA. L. (2004). Emotional attribution in high-functioning individuals with autistic spectrum disorder: A functional imaging study. Journal of the American Academy of Child and Adolescent Psychiatry, 43(4), 473–480. https://doi.org/10.1097/00004583-200404000-00014
47.
PortnovaG. V.MaslennikovaA. V. (2020). Atypical EEG responses to nonverbal emotionally charged stimuli in children with ASD. Behavioural Neurology, 2020, 2807946.
48.
QuintinE.-M.BhataraA.PoissantH.FombonneE.LevitinD. J. (2011). Emotion perception in music in high-functioning adolescents with autism spectrum disorders. Journal of Autism and Developmental Disorders, 41(9), 1240–1255. https://doi.org/10.1007/s10803-010-1146-0
49.
Ramirez-MelendezR.MatamorosE.HernandezD.MirabelJ.SanchezE.EscudeN. (2022). Music-enhanced emotion identification of facial emotions in autistic spectrum disorder children: A pilot EEG study. Brain Sciences, 12(6), 704. https://www.mdpi.com/2076-3425/12/6/704
50.
Redondo PedregalC.HeatonP. (2021). Autism, music and alexithymia: A musical intervention to enhance emotion recognition in adolescents with ASD. Research in Developmental Disabilities, 116, 104040. https://doi.org/10.1016/j.ridd.2021.104040
51.
RutherfordM. D.McIntoshD. N. (2006). Rules versus prototype matching: Strategies of perception of emotional facial expressions in the autism spectrum. Journal of Autism and Developmental Disorders, 37(2), 187–196. https://doi.org/10.1007/s10803-006-0151-9
52.
SangB.MiaoX. (1990). Peabody Picture Vocabulary Test Revision (PPVT-R) revision of the Shanghai urban trial norm. Psychological Science Communication, 5, 22–276765. https://doi.org/10.16719/j.cnki.1671-6981.1990.05.004
53.
SeolK. I.SongS. H.KimK. L.OhS. T.KimY. T.ImW. Y.SongD. H.CheonK.-A. (2014). A comparison of receptive-expressive language profiles between toddlers with autism spectrum disorder and developmental language delay. Yonsei Medical Journal, 55(6), 1721–1728. https://doi.org/10.3349/ymj.2014.55.6.1721
54.
SollbergeB.RebeR.EcksteinD. (2003). Musical chords as affective priming context in a word-evaluation task. Music Perception: An Interdisciplinary Journal, 20(3), 263–282. https://doi.org/10.1525/mp.2003.20.3.263
55.
SorensenT.ZaneE.FengT.NarayananS.GrossmanR. (2019). Cross-modal coordination of face-directed gaze and emotional speech production in school-aged children and adolescents with ASD. Scientific Reports, 9(1), 18301. https://doi.org/10.1038/s41598-019-54587-z
56.
StanutzS.WapnickJ.BurackJ. A. (2014). Pitch discrimination and melodic memory in children with autism spectrum disorders. Autism, 18(2), 137–147. https://doi.org/10.1177/1362361312462905
57.
TaylorL. J.MayberyM. T.GrayndlerL.WhitehouseA. J. O. (2015). Evidence for shared deficits in identifying emotions from faces and from voices in autism spectrum disorders and specific language impairment. International Journal of Language & Communication Disorders, 50(4), 452–466. https://doi.org/10.1111/1460-6984.12146
58.
TracyJ. L.RobinsR. W.SchriberR. A.SolomonM. (2011). Is emotion recognition impaired in individuals with autism spectrum disorders?Journal of Autism and Developmental Disorders, 41(1), 102–109.
59.
UljarevicM.HamiltonA. (2013). Recognition of emotions in autism: A formal meta-analysis. Journal of Autism and Developmental Disorders, 43(7), 1517–1526. https://doi.org/10.1007/s10803-012-1695-5
60.
WagenerG. L.BerningM.CostaA. P.SteffgenG.MelzerA. (2021). Effects of emotional music on facial emotion recognition in children with Autism Spectrum Disorder (ASD). Journal of Autism and Developmental Disorders, 51(9), 3256–3265. https://doi.org/10.1007/s10803-020-04781-0
61.
ZhangW.LiuF.ZhouL.WangW.JiangH.JiangC. (2019). The effects of timbre on neural responses to musical emotion. Music Perception, 37(2), 134–146. https://doi.org/10.1525/mp.2019.37.2.134
