This study systematically reviews the evolution of Music Emotion Computing (MEC) over the past decade, focusing on its two core branches: Music Emotion Recognition (MER) and Music Sentiment Analysis (MSA). Through a comprehensive bibliometric analysis, the research aims to uncover emerging trends, interdisciplinary and cross-regional collaboration patterns, and key application areas within this field. Using data collected from the Web of Science Core Collection (WoSCC), we conducted a comprehensive bibliometric analysis to map global academic output, highlighting influential studies, leading authors, and primary collaborative networks in MEC. Results indicate that research in MEC has exhibited significant growth over the last ten years, especially with heightened interest in applications such as multimodal emotion analysis and personalized music recommendation systems. MEC research demonstrates a high degree of interdisciplinary integration, with contributions from computer science, psychology, and neuroscience jointly driving advances in the field. Cross-regional collaboration analysis shows that Asia, Europe, and North America are the primary research hubs, characterized by extensive intercontinental partnerships. Current trends reveal a strong focus on multimodal MEC and deep learning-based methods combining audio, text, video as well as biosignals, suggesting future potential for MEC in areas like multimodal interaction, intelligent emotional feedback, and real-world applications, including mental health and music creation. Additionally, the study identifies challenges facing MEC applications, such as technical hurdles in multimodal data fusion, cultural variations in emotional perception, and concerns surrounding data privacy and ethics. Based on these findings, future research should further explore integration across diverse data sources, enhance the interpretability and generalizability of emotion recognition models, and innovate methods for cross-cultural emotion computing. This study provides a panoramic perspective for scholars in the MEC field and offers strategic recommendations for future research.
AbdulA.ChenJ.LiaoH.ChangS. (2018). An Emotion-Aware personalized music recommendation system using a convolutional neural networks approach. Applied Sciences, 8(7), 1103. https://doi.org/10.3390/app8071103
2.
AgathaH.PutriF. P.SuryadibrataA. (2021). Sentiment analysis on song lyrics for song popularity prediction using BERT. Jurnal Teknik Informatika, 15(2), 99–105. https://doi.org/10.31937/ti.v15i2.3420
3.
AljanakiA.WieringF.VeltkampR. C. (2015). Studying emotion induced by music through a crowdsourcing game. Information Processing & Management, 52(1), 115–128. https://doi.org/10.1016/j.ipm.2015.03.004
4.
AnY.SunS.WangS. (2017). Naive Bayes Classifiers for Music Emotion Classification based on lyrics. In 2017 IEEE/ACIS 16th International Conference on Computer and Information Science (ICIS).https://doi.org/10.1109/icis.2017.7960070
5.
ArgstatterH. (2016). Perception of basic emotions in music: Culture-specific or multicultural?Psychology of Music, 44(4), 674–690. https://doi.org/10.1177/0305735615589214
6.
AriaM.CuccurulloC. (2017). Bibliometrix: An R-tool for comprehensive science mapping analysis. Journal of Informetrics, 11(4), 959–975. https://doi.org/10.1016/j.joi.2017.08.007
7.
AyataD.YaslanY.KamasakM. E. (2018). Emotion based music recommendation system using wearable physiological sensors. IEEE Transactions on Consumer Electronics, 64(2), 196–203. https://doi.org/10.1109/tce.2018.2844736
8.
BaltazarM.VästfjällD. (2020). Songs perceived as relaxing: Musical features, lyrics, and contributing mechanisms. In The first international conference psychology and music – interdisciplinary encounters. https://jyx.jyu.fi/handle/123456789/72760
9.
BigandE.VieillardS.MadurellF.MarozeauJ.DacquetA. (2005). Multidimensional scaling of emotional responses to music: The effect of musical expertise and of the duration of the excerpts. Cognition & Emotion, 19(8), 1113–1139. https://doi.org/10.1080/02699930500204250
10.
BogertB.Numminen-KonttiT.GoldB.SamsM.NumminenJ.BurunatI.LampinenJ.BratticoE. (2016). Hidden sources of joy, fear, and sadness: Explicit versus implicit neural processing of musical emotions. Neuropsychologia, 89, 393–402. https://doi.org/10.1016/j.neuropsychologia.2016.07.005
11.
CaetanoM.MouchtarisA.WieringF. (2013). The role of time in music emotion recognition: Modeling musical emotions from time-varying music features. In In MitsukoAramakiMathieuBarthettRichardKronland-MartinetSølviYstad (Eds.), Lecture notes in computer science (pp. 171–196). Springer. https://doi.org/10.1007/978-3-642-41248-6_10
12.
CaiL.CaiQ. (2019). Music creation and emotional recognition using neural network analysis. Journal of Ambient Intelligence and Humanized Computing, 15(S1), 87. https://doi.org/10.1007/s12652-019-01614-6
13.
ChenY.YangY.WangJ.ChenH. (2015). The AMG1608 dataset for music emotion recognition. In 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), South Brisbane, QLD, 19–24 April 2015. https://doi.org/10.1109/icassp.2015.7178058
14.
CroomA. M. (2014). Music practice and participation for psychological well-being: A review of how music influences positive emotion, engagement, relationships, meaning, and accomplishment. Musicae Scientiae, 19(1), 44–64. https://doi.org/10.1177/1029864914561709
15.
CuiX.WuY.WuJ.YouZ.XiahouJ.OuyangM. (2022). A review: Music-emotion recognition and analysis based on EEG signals. Frontiers in Neuroinformatics, 16, 997282. https://doi.org/10.3389/fninf.2022.997282
16.
De NooyW.MrvarA.BatageljV. (2018). Exploratory social network analysis with Pajek. Cambridge University Press. https://doi.org/10.1017/9781108565691
17.
DevaneyJ. (2020). Using note-level music encodings to facilitate interdisciplinary research on human engagement with music. Transactions of the International Society for Music Information Retrieval, 3(1), 205–217. https://doi.org/10.5334/tismir.56
18.
DongY.YangX.ZhaoX.LiJ. (2019). Bidirectional Convolutional Recurrent Sparse Network (BCRSN): An efficient model for music emotion recognition. IEEE Transactions on Multimedia, 21(12), 3150–3163. https://doi.org/10.1109/tmm.2019.2918739
19.
GallegoM. G.GarcíaJ. G. (2017). Music therapy and Alzheimer’s disease: Cognitive, psychological, and behavioural effects. Neurologia, 32(5), 300–308. https://doi.org/10.1016/j.nrleng.2015.12.001
20.
GildaS.ZafarH.SoniC.WaghurdekarK. (2017). Smart music player integrating facial emotion recognition and music mood recommendation. In 2017 international conference on Wireless Communications, Signal Processing and Networking (WiSPNET), Chennai, India, 22–24 March 2017. https://doi.org/10.1109/wispnet.2017.8299738
21.
GoelS.MonicaN.KhuranaH.JainP. (2022). Social media analysis: A tool for popularity prediction using machine learning classifiers. In DiptiSinghVanitaGargKusumDeep (Eds.), Women in engineering and science (pp. 179–197). Springer. https://doi.org/10.1007/978-3-031-17929-7_9
22.
Gomez-CanonJ. S.CanoE.EerolaT.HerreraP.HuX.YangY.GomezE. (2021). Music emotion recognition: Toward new, robust standards in personalized and context-sensitive applications. IEEE Signal Processing Magazine, 38(6), 106–114. https://doi.org/10.1109/msp.2021.3106232
23.
Gómez-CañónJ. S.Gutiérrez-PáezN.PorcaroL.PorterA.CanoE.Herrera-BoyerP.GkiokasA.SantosP.Hernández-LeoD.KarremanC.GómezE. (2022). TROMPA-MER: An open dataset for personalized music emotion recognition. Journal of Intelligent Information Systems, 60(2), 549–570. https://doi.org/10.1007/s10844-022-00746-0
GuofangZ.RasulM. S.OmarM. (2024). A bibliometric analysis of publications on University-Industry collaboration using VOSViewer and R-Biblioshiny. Multidisciplinary Journal for Education Social and Technological Sciences, 11(2), 26–50. https://doi.org/10.4995/muse.2024.21167
26.
Hassan-MonteroY.De-Moya-AnegónF.Guerrero-BoteV. P. (2022). SCImago Graphica: A new tool for exploring and visually communicating data. El Profesional de la Información, 31(5). https://doi.org/10.3145/epi.2022.sep.02
27.
HevnerK. (1936). Experimental studies of the elements of expression in music. American Journal of Psychology, 48(2), 246. https://doi.org/10.2307/1415746
28.
HizlisoyS.YildirimS.TufekciZ. (2021). Music emotion recognition using convolutional long short term memory deep neural networks. Engineering Science and Technology an International Journal, 24(3), 760–767. https://doi.org/10.1016/j.jestch.2020.10.009
29.
HuX.YangY. (2016). Cross-dataset and cross-cultural music mood prediction: A case on Western and Chinese pop songs. IEEE Transactions on Affective Computing, 8(2), 228–240. https://doi.org/10.1109/taffc.2016.2523503
30.
JiaX. (2022). A music emotion classification model based on the improved convolutional neural network. Computational Intelligence and Neuroscience, 2022, 1–11. https://doi.org/10.1155/2022/6749622
31.
JiangJ.RicksonD.JiangC. (2016). The mechanism of music for reducing psychological stress: Music preference as a mediator. The Arts in Psychotherapy, 48, 62–68. https://doi.org/10.1016/j.aip.2016.02.002
32.
JuslinP. N.VästfjällD. (2008). Emotional responses to music: The need to consider underlying mechanisms. Behavioral and Brain Sciences, 31(5), 559–575. https://doi.org/10.1017/s0140525x08005293
33.
KimY. E.SchmidtE. M.MignecoR.MortonB. G.RichardsonP.ScottJ.SpeckJ. A.TurnbullD. (2010). Music emotion recognition: A state of the art review. In 11th International Society for Music Information Retrieval conference (ISMIR 2010) (p. 255). Utrecht, Netherlands. https://ismir2010.ismir.net/proceedings/ismir2010-45.pdf.
34.
KumpulainenI.PraksE.KorhonenT.NiA.RissanenV.VankkaJ. (2020). Predicting Eurovision song contest results using sentiment analysis. In Communications in computer and information science (pp. 87–108). https://doi.org/10.1007/978-3-030-59082-6_7
35.
LiuH.LouT.ZhangY.WuY.XiaoY.JensenC. S.ZhangD. (2024). EEG-based multimodal emotion recognition: A machine learning perspective. IEEE Transactions on Instrumentation and Measurement, 1, 1–29. https://doi.org/10.1109/tim.2024.3369130
36.
LiuW.ZhengW.LiZ.WuS.GanL.LuB. (2022). Identifying similarities and differences in emotion recognition with EEG and eye movements among Chinese, German, and French People. Journal of Neural Engineering, 19(2), 026012. https://doi.org/10.1088/1741-2552/ac5c8d
37.
MageeW. L.DavidsonJ. W. (2002). The effect of music therapy on mood states in neurological patients: A pilot study. Journal of Music Therapy, 39(1), 20–29. https://doi.org/10.1093/jmt/39.1.20
38.
MiniP.ThomasT.GopikakumariR. (2021). EEG based direct speech BCI system using a fusion of SMRT and MFCC/LPCC features with ANN classifier. Biomedical Signal Processing and Control, 68, 102625. https://doi.org/10.1016/j.bspc.2021.102625
39.
MoscatoV.PicarielloA.SperliG. (2020). An emotional recommender system for music. IEEE Intelligent Systems, 36(5), 57–68. https://doi.org/10.1109/mis.2020.3026000
40.
PandaR.MalheiroR.PaivaR. P. (2020). Audio features for music emotion recognition: A survey. IEEE Transactions on Affective Computing, 14(1), 68–88. https://doi.org/10.1109/taffc.2020.3032373
41.
PandaR.RochaB.PaivaR. P. (2015). Music emotion recognition with standard and melodic audio features. Applied Artificial Intelligence, 29(4), 313–334. https://doi.org/10.1080/08839514.2015.1016389
42.
PandeyaY. R.BhattaraiB.LeeJ. (2021). Deep-Learning-Based multimodal emotion classification for music videos. Sensors, 21(14), 4927. https://doi.org/10.3390/s21144927
43.
PandeyaY. R.LeeJ. (2020). Deep learning-based late fusion of multimodal information for emotion classification of music video. Multimedia Tools and Applications, 80(2), 2887–2905. https://doi.org/10.1007/s11042-020-08836-3
44.
ProverbioA. M.RussoF. (2021). Multimodal recognition of emotions in music and language. Psychology of Music, 50(1), 54–68. https://doi.org/10.1177/0305735620978697
45.
QiuJ.ChenC. L. P.ZhangT. (2022). A novel multi-task learning method for symbolic music emotion recognition. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2201.05782
46.
RayK. D.MittelmanM. S. (2015). Music therapy: A nonpharmacological approach to the care of agitation and depressive symptoms for nursing home residents with dementia. Dementia, 16(6), 689–710. https://doi.org/10.1177/1471301215613779
47.
RussellJ. A. (1980). A circumplex model of affect. Journal of Personality and Social Psychology, 39(6), 1161–1178. https://doi.org/10.1037/h0077714
SamsA. S.ZahraA. (2022). Multimodal music emotion recognition in Indonesian songs based on CNN-LSTM, XLNet transformers. Bulletin of Electrical Engineering and Informatics, 12(1), 355–364. https://doi.org/10.11591/eei.v12i1.4231
50.
SantanaM. A.NunesI. B.FonsecaF. S.TorcateA. S.SuarezA.MarquesV.CórdulaN.GomesJ. C.MorenoG. M. M.SantosW. P. D. (2023). Identification of emotion parameters in music to modulate human affective states (pp. 198–221). CRC Press eBooks. https://doi.org/10.1201/9781003201137-11
51.
SarkarR.ChoudhuryS.DuttaS.RoyA.SahaS. K. (2019). Recognition of emotion in music based on deep convolutional neural network. Multimedia Tools and Applications, 79(1–2), 765–783. https://doi.org/10.1007/s11042-019-08192-x
52.
SaxenaG. D.FarooquiN. A.AliS. (2022). Extricate features utilizing MEL frequency cepstral coefficient in automatic speech recognition system. International Journal of Engineering and Manufacturing, 12(6), 14–21. https://doi.org/10.5815/ijem.2022.06.02
53.
SchererK. R. (2004). Which emotions can be induced by music? What are the underlying mechanisms? And how can we measure them?Journal of New Music Research, 33(3), 239–251. https://doi.org/10.1080/0929821042000317822
54.
SeoY.HuhJ. (2019). Automatic Emotion-Based Music classification for supporting intelligent IoT applications. Electronics, 8(2), 164. https://doi.org/10.3390/electronics8020164
55.
ShenT.JiaJ.LiY.WangH.ChenB. (2020). Enhancing music recommendation with social media content: An attentive multimodal autoencoder approach. In 2020 International Joint Conference on Neural Networks (IJCNN) (pp. 1–8). Glasgow, UK. https://doi.org/10.1109/ijcnn48605.2020.9206894
56.
SheykhivandS.MousaviZ.RezaiiT. Y.FarzamniaA. (2020). Recognizing emotions evoked by music using CNN-LSTM networks on EEG signals. IEEE Access, 8, 139332–139345. https://doi.org/10.1109/access.2020.3011882
57.
ShiY.ZhuX.KimH.EomK. (2006). A tempo feature via modulation spectrum analysis and its application to music emotion classification. In 2006 IEEE international conference on multimedia and Expo, Toronto, ON, Canada, 09–12 July 2006. https://doi.org/10.1109/icme.2006.262723
58.
ShuklaS.KhannaP.AgrawalK. K. (2017). Review on sentiment analysis on music. In 2017 International Conference on Infocom Technologies and Unmanned Systems (trends and future directions) (ICTUS), Dubai, United Arab Emirates, 18–20 December 2017. https://doi.org/10.1109/ictus.2017.8286111
59.
TellegenA.WatsonD.ClarkL. A. (1999). On the dimensional and hierarchical structure of affect. Psychological Science, 10(4), 297–303. https://doi.org/10.1111/1467-9280.00157
TongG. (2022). Multimodal music emotion recognition method based on the combination of knowledge distillation and transfer learning. Scientific Programming, 2022, 1–13. https://doi.org/10.1155/2022/2802573
63.
TzanetakisG.CookP. (2002). Musical genre classification of audio signals. IEEE Transactions on Speech and Audio Processing, 10(5), 293–302. https://doi.org/10.1109/tsa.2002.800560
64.
Van EckN. J.WaltmanL. (2009). Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometrics, 84(2), 523–538. https://doi.org/10.1007/s11192-009-0146-3
65.
WangQ.QuY.ChengH.YuY.WangX.GuB. (2024). AI-Driven Sentiment Analysis for music composition. In JianghuaLiuLeiXuXinyiHuang (Eds.), Lecture notes of the institute for computer sciences, social informatics and telecommunications engineering (pp. 75–84). Springer. https://doi.org/10.1007/978-3-031-51399-2_4
66.
WangX.WangL.XieL. (2022). Comparison and analysis of acoustic features of Western and Chinese classical music emotion recognition based on V-A model. Applied Sciences, 12(12), 5787. https://doi.org/10.3390/app12125787
67.
WangY. (2021). Music composition and emotion recognition using big data technology and neural network algorithm. Computational Intelligence and Neuroscience, 2021, 1–11. https://doi.org/10.1155/2021/5398922
68.
WangJ.YangY.WangH.JengS. (2015). Modeling the Affective Content of Music with a Gaussian Mixture Model. IEEE Transactions on Affective Computing, 6(1), 56–68. https://doi.org/10.1109/taffc.2015.2397457
69.
WiswedeG. (2000). Robert freed bales: Social interaction systems. Theory and measurement. KZfSS Kölner Zeitschrift Für Soziologie Und Sozialpsychologie, 52(3), 565–567. https://doi.org/10.1007/s11577-000-0075-x
70.
XiaY.WangL.WongK.XuM. (2008). Sentiment vector space model for lyric-based song sentiment classification. International Journal of Computer Processing of Languages, 133, 133. https://doi.org/10.3115/1557690.1557725
71.
XingB.ZhangK.SunS.ZhangL.GaoZ.WangJ.ChenS. (2014). Emotion-driven Chinese folk music-image retrieval based on DE-SVM. Neurocomputing, 148, 619–627. https://doi.org/10.1016/j.neucom.2014.08.007
72.
YangX.DongY.LiJ. (2017). Review of data features-based music emotion recognition methods. Multimedia Systems, 24(4), 365–389. https://doi.org/10.1007/s00530-017-0559-4
73.
YangY.LinY.SuY.ChenH. H. (2008). A regression approach to music emotion recognition. IEEE Transactions on Audio Speech and Language Processing, 16(2), 448–457. https://doi.org/10.1109/tasl.2007.911513
74.
YinG.SunS.YuD.LiD.ZhangK. (2022). A multimodal framework for large-scale emotion recognition by fusing music and electrodermal activity signals. ACM Transactions on Multimedia Computing, Communications, and Applications, 18(3), 1–23. https://doi.org/10.1145/3490686
75.
ZhangK.ZhangH.LiS.YangC.SunL. (2018). The PMEMO Dataset for Music Emotion Recognition. In ICMR’18: proceedings of the 2018 ACM International Conference on Multimedia Retrieval: June 11-14, 2018, Yokohama, Japan. The Association for Computing Machinery (pp. 135–142). New York. https://doi.org/10.1145/3206025.3206037
76.
ZhaoJ.RuG.YuY.WuY.LiD.LiW. (2022). Multimodal music emotion recognition with hierarchical cross-modal attention network. In 2022 IEEE International Conference on Multimedia and Expo (ICME), Taipei, Taiwan, 18–22 July 2022. https://doi.org/10.1109/icme52920.2022.9859812
77.
ZhouT. H.LiangW.LiuH.WangL.RyuK. H.NamK. W. (2022). EEG emotion recognition applied to the effect analysis of music on emotion changes in psychological healthcare. International Journal of Environmental Research and Public Health, 20(1), 378. https://doi.org/10.3390/ijerph20010378
