The bimodal perception of speech sounds was examined in children with autism as compared to mental age—matched typically developing (TD) children. A computer task was employed wherein only the mouth region of the face was displayed and children reported what they heard or saw when presented with consonant-vowel sounds in unimodal auditory condition, unimodal visual condition, and a bimodal condition. Children with autism showed less visual influence and more auditory influence on their bimodal speech perception as compared to their TD peers, largely due to significantly worse performance in the unimodal visual condition (lip reading). Children with autism may not benefit to the same extent as TD children from visual cues such as lip reading that typically support the processing of speech sounds. The disadvantage in lip reading may be detrimental when auditory input is degraded, for example in school settings, whereby speakers are communicating in frequently noisy environments.
Boucher, J., Lewis, V., & Collis, G. ( 1998) ‘Familiar Face and Voice Matching and Recognition in Children with Autism’, Journal of Child Psychology and Psychiatry39: 171-181.
Campbell, R. ( 1989) ‘The Sensory Imperative: Modularity and the Development of Face Processing in the Neonate’, Cahiers de Psychologie Cognitive/Current Psychology of Cognition9: 55-59.
4.
Campbell, R., Garwood, J., Franklin, S., & Howard, D. ( 1990) ‘Neuropsychological Studies of Auditory-Visual Fusion Illusions: Four Case Studies and Their Implications’, Neuropsychologia28: 787-802.
5.
Čeponienė, R., Lepistö, T., Alku, P., Aro, H., & Näätänen, R. (2003) ‘Event-Related Potential Indices of Auditory Vowel Processing in 3-Year-Old Children’ , Clinical Neurophysiology114: 652-661.
6.
Colin, C., Radeau, M., & Deltenre, P. ( 2005) ‘Top-Down and Bottom-Up Modulation of Audiovisual Integration in Speech’, European Journal of Cognitive Psychology17: 541-560.
7.
Davis, C. & Kim, J. ( 2006) ‘Audio-Visual Speech Perception off the Top of the Head’, Cognition100(3): B21-B31.
8.
Dawson, G., Webb, S.J., & McPartland, J. (2005) ‘Understanding the Nature of Face Processing Impairment in Autism: Insights from Behavioral and Electrophysiological Studies’, Developmental Neuroscience27(3): 403-424.
9.
de Gelder, B., & Vroomen, J. ( 1998) ‘Impaired Speech Perception in Poor Readers: Evidence from Hearing and Speech Reading’, Brain and Language64: 269-281.
10.
de Gelder, B., Vroomen, J., & Bachoud-Levi, A. (1998) ‘Impaired Speech Reading and Audio-Visual Speech Integration in Prosopagnosia’, in R. Campbell, B. Dodd & D. Burnham (eds.) Hearing by Eye II: Advances in the Psychology of Speechreading and Auditory-Visual Speech (pp. 195-207). Hove, UK: Psychology Press/Erlbaum (UK) Taylor & Francis.
11.
de Gelder, B., Vroomen, J., & van der Heide, L. (1991) ‘Face Recognition and Lip-Reading in Autism’, European Journal of Cognitive Psychology3: 69-86.
12.
Dunn, L.M., & Dunn, L.M. ( 1997) Peabody Picture Vocabulary Test - Third Edition . Minnesota: American Guidance Service.
13.
Greenspan, S.I., & Wieder, S. ( 1997) ‘An Integrated Developmental Approach to Interventions for Young Children with Severe Difficulties in Relating and Communicating’ , Zero to Three17: 5-18.
14.
Iarocci, G., & McDonald, J. ( 2006) ‘Sensory Integration and the Perceptual Experience of Persons with Autism’, Journal of Autism and Developmental Disorders36: 77-90.
15.
Kenworthy, L., Black, D.O., Harrison, B., della Rosa, A., della Rosa, W., & Gregory, L. ( 2009) ‘Are Executive Control Functions Related to Autism Symptoms in High-Functioning Children?’Child Neuropsychology9(1): 1-6.
16.
Klin, A., Jones, W., Schultz, R., Volkmar, F., & Cohen, D. ( 2002) ‘Visual Fixation Patterns During Viewing of Naturalistic Social Situations as Predictors of Social Competence in Individuals with Autism’ , Archives of General Psychiatry59(9): 809-816.
17.
Lansing, C.R., & McConkie, G.W. (1999) ‘Attention to Facial Regions in Segmental and Prosodic Visual Speech Perception Tasks’, Journal of Speech, Language, and Hearing Research42: 526-539.
18.
Lansing, C.R., & McConkie, G.W. (2003) ‘Word Identification and Eye Fixation Locations in Visual and Visual-Plus-Auditory Presentations of Spoken Sentences’, Perception & Psychophysics65(4): 536-552.
19.
Loveland, K.A., Tunali-Kotoski, B., Chen, R., & Brelsford, K.A. (1995) ‘Intermodal Perception of Affect in Persons with Autism or Down syndrome’, Development and Psychopathology7: 409-418.
20.
Marschark, M., LePoutre, D., & Bement, L. ( 1998) ‘Mouth Movement and Signed Communication’ , in R. Campbell, B. Dodd & D. Burnham (eds.), Hearing by Eye II: Advances in the Psychology of Speechreading and Auditory-Visual Speech (pp. 245-266). Hove, UK: Psychology Press/Erlbaum (UK) Taylor & Francis.
21.
Massaro, D.W. ( 1984) ‘Children’s Perception of Visual and Auditory Speech’, Child Development55: 1777-1788.
22.
Massaro, D. ( 1987) ‘Speech Perception by Ear and Eye’ , in B. Dodd & R. Campbell (eds.), Hearing by Eye:The Psychology of Lip-Reading (pp. 53-83). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
23.
Massaro, D. ( 1998) Perceiving Talking Faces: From Speech Perception to a Behavioral Principle. Cambridge Massachusetts: MIT Press.
24.
McGurk, H., & MacDonald, J. ( 1976) ‘Hearing Lips and Seeing Voices’, Nature264: 746-748.
25.
Middelweerd, M., & Plomp, R. ( 1987) ‘The Effect of Speechreading on the Speech-Reception Threshold of Sentences in Noise’, Journal of the Acoustical Society of America82(6): 2145-2147.
26.
Newman, R.S. ( 2005) ‘The Cocktail Party Effect in Infants Revisited: Listening to One’s Name in Noise’, Developmental Psychology41: 352-262.
27.
O’Neill, M., & Jones, R.S.P. ( 1997) ‘Sensory-Perceptual Abnormalities in Autism: A Case for More Research?’Journal of Autism and Development Disorders27: 283-293.
28.
Plaisted, K., Saksida, L., Alcántara, J., & Weisblatt, E. ( 2003) ‘Towards an Understanding of the Mechanisms of Weak Central Coherence Effects: Experiments in Visual Configural Learning and Auditory Perception’, Philosophical Transactions of the Royal Society: Part B358: 375-386.
29.
Preminger, J.E., Lin, H., Payen, M., & Levitt, H. ( 1998) ‘Selective Visual Masking in Speechreading’ , Journal of Speech, Language, and Hearing Research41: 564-575.
Rutter, M., Le Couteur, A., & Lord, C. ( 2003) Autism Diagnostic Interview-Revised. Los Angeles: Western Psychological Services.
32.
Scharre, J.E., & Creedon, M.P. ( 1992) ‘Assessment of Visual Function in Autistic Children’ , Optometry and Vision Science: Official Publication of the American Academy of Optometry69: 433-439.
33.
Scheinberg, J.C. ( 1980) ‘Analysis of Speechreading Cues Using an Interleaved Technique’, Journal of Communication Disorders13: 489-492.
34.
Smith, E., & Bennetto, L. ( 2007) ‘Audiovisual Speech Integration and Lipreading in Autism’, Journal of Child Psychology and Psychiatry48(8): 813-821.
35.
Summerfield, Q., & McGrath, M. ( 1984) ‘Detection and Resolution of Audio-Visual Incompatibility in the Perception of Vowels’, The Quarterly Journal of Experimental Psychology A: Human Experimental Psychology36: 51-74.
36.
Thomas, S.M., & Jordan, T.R. ( 2004) ‘Contributions of Oral and Extraoral Facial Movement to Visual and Audiovisual Speech Perception’, Journal of Experimental Psychology: Human Perception and Performance30: 873-888.
37.
Williams, J.H.G., Massaro, D.W., Peel, N.J., Bosseler, A., & Suddendorf, T. (2004) ‘Visual-Auditory Integration During Speech Imitation in Autism’, Research in Developmental Disabilities25: 569-575.
