Voice processing has proven to be an eminent way of recognizing the various emotions of the people. The objective of this research is to identify the presence of Autism Spectrum Disorder (ASD) and to analyze the emotions of autistic children through their voices. The presented automated voice-based system can detect and classify seven basic emotions (anger, disgust, neutral, happiness, calmness, fear and sadness) expressed by children through source parameters associated with their voices. Various prime voice features such as Mel-frequency Cepstral Coefficients (MFCC) and Spectrogram are extracted and utilized to train a Multi-layer Perceptron (MLP) Classifier to identify possible emotions exhibited by the children thereby assessing their behavioral state. This proposed work therefore helps in the examination of emotions in autistic children that can be used to assess the kind of training and care required to enhance their lifestyle.
MohantaA., MukherjeeP. and Kumar MittalV., Acoustic Features Characterization of Autism Speech for Automated Detection and Classification, 2020 National Conference on Communications (NCC), (2020), pp. 1-6, doi: 10.1109/NCC48643.2020.9056025
2.
Ben-DavidB.M., Ben-ItzchakE., ZukermanG., YahavG. and IchtM., The Perception of Emotions in Spoken Language in Undergraduates with High Functioning Autism Spectrum Disorder: A Preserved Social Skill, Journal of Autism and Developmental Disorders, 2019.
3.
KiranaM.C., LubisM.Z. and AmaliaE.D., The Effect of Sound Manipulation to Know Response Rate in Autism Children Using FFT, International Conference on Applied Engineering (ICAE), (2018), pp. 1-5, doi: 10.1109/INCAE.2018.8579418
4.
MinC-H. and FetznerJ., Vocal Stereotypy Detection: An Initial Step to Understanding Emotions of Children with Autism Spectrum Disorder, 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, (2018), pp. 3306-3309, doi: 10.1109/EMBC.2018.8513050
5.
SchelinskiS. and von KriegsteinK., The Relation Between Vocal Pitch and Vocal Emotion Recognition Abilities in People with Autism Spectrum Disorder and Typical Development, Journal of Autism and Developmental Disorders, 2019.
6.
AttawibulkulS., KaewkamnerdpongB. and MiyanagaY., Noisy Speech Training in MFCC-based Speech Recognition with Noise Suppression Toward Robot Assisted Autism therapy, Biomedical Engineering International Conference, 2017
7.
DengJ., CumminsN., SchmiM., QianK., RingevalF. and SchullerB., Speech-based Diagnosis of Autism Spectrum Condition by Generative Adversarial Network Representations, In Proceedings of DH’17, 2017.
8.
Ashok KumarK. and Mazher IqbalJ.L., Machine Learning Based Emotion Recognition using Speech Signal, International Journal of Engineering and Advanced Technology, ISSN: 2249 – 8958, Volume-9 Issue-1S5, December, 2019.
9.
WijesingheA., SamarasingheP., SeneviratneS., YogarajahP. and PulasingheK., Machine Learning Based Automated Speech Dialog Analysis Of Autistic Children, 11th International Conference on Knowledge and Systems Engineering (KSE), 2019.
10.
Nithya RoopaS., PrabhakaranM. and BettyP., Speech Emotion Recognition using Deep Learning, International Journal of Recent Technology and Engineering, ISSN: 2277-3878, Volume-7 Issue-4S, November 2018.
11.
van den BekeromB., Using Machine Learning for Detection of Autism Spectrum Disorder, Twente Student Conference, 2017.
12.
GarridoD., WatsonL.R., CarballoG., Garcia-RetameroR. and CraisE.R., Infants At-Risk for Autism Spectrum Disorder: Patterns of Vocalizations at 14 Months, International Society for Autism Research, Wiley Periodicals, 2017.
13.
Cristina, et al., Emotion recognition in typical and atypical development – a technology-based paradigm, 10th IEEE International Conference on Cognitive Infocommunications (CogInfoCom), 2019.
14.
DeshmukhG., GaonkarA., GolwalkarG. and KulkarniS., Speech based Emotion Recognition using Machine Learning, 3rd International Conference on Computing Methodologies and Communication (ICCMC), 2019.
15.
Valerie, et al., Enhanced Sensitivity to Angry Voices in People with Features of the Broader Autism Phenotype, Journal of Autism and Developmental Disorders, 2018.
16.
MatsumotoK., et al., Behavioral Study on Emotional Voice Perception in Children with Autism Spectrum Disorder, American Academy of Pediatric Neuropsychology 2017.
17.
StronachSheri T. and WetherbyAmy M., Observed and Parent-Report Measures of Social Communication in Toddlers With and Without Autism Spectrum Disorder Across Race/Ethnicity, American Journal of Speech-Language Pathology, 2017.
18.
HubbardDaniel J., et al., Production and perception of emotional prosody by adults with autism spectrum disorder, International Society for Autism Research, Wiley Periodicals, 2017.
19.
Yasufumi, et al., Characteristics of the Understanding and Expression of Emotional Prosody among Children with Autism Spectrum Disorder, Autism Open Access, DOI: 10.4172/2165-7890.1000185, 2016
20.
RingevalF., MarchiE., GrossardC., XavierJ., ChetouaniM., et al., Automatic Analysis of Typical and Atypical Encoding of Spontaneous Emotion in the Voice of Children, Proceedings INTERSPEECH 2016, 17th Annual Conference of the International Speech Communication Association (ISCA), 2016.
21.
McFeeB., RaffelC., LiangD., EllisDaniel P.W., McVicarM., BattenberE. and NietokO., librosa: Audio and Music Signal Analysis in Python, Proceedings of 14th Python in Science Conference, 2015.
22.
SantosJoao F., et al., Very early detection of Autism Spectrum Disorders based on acoustic analysis of pre-verbal vocalizations of 18-month old toddlers, IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2013.
23.
HarteC., SandlerM. and GasserM., Detecting Harmonic Change In Musical Audio, Proceedings of the 1st ACM workshop on Audio and music computing multimedia, 2006.
24.
KimC., et al., Mel-Frequency Cepstral Coefficient Analysis in Speech Recognition, International Conference on Computing & Informatics, 2006.
25.
StevensS.S. and VolkmannJ., The Relation of Pitch to Frequency: A Revised Scale,pp, The American Journal of Psychology53(3) (1940), 329–353.
26.
Dongxin, et al., Objective Child Behavior Measurement with Naturalistic Daylong Audio Recording and its Application to Autism Identification, International Conference of the IEEE EMBS, 2012.
