It has been recently theorized that atypical sensory processing in autism relates to difficulties in social communication. Through a series of tasks concurrently assessing multisensory temporal processes, multisensory integration and speech perception in 76 children with and without autism, we provide the first behavioral evidence of such a link. Temporal processing abilities in children with autism contributed to impairments in speech perception. This relationship was significantly mediated by their abilities to integrate social information across auditory and visual modalities. These data describe the cascading impact of sensory abilities in autism, whereby temporal processing impacts multisensory information of social information, which, in turn, contributes to deficits in speech perception. These relationships were found to be specific to autism, specific to multisensory but not unisensory integration, and specific to the processing of social information.
BaranekGTDavidFJPoeMD. (2006) Sensory Experiences Questionnaire: discriminating sensory features in young children with autism, developmental delays, and typical development. Journal of Child Psychology and Psychiatry47: 591–601.
4.
Baron-CohenS (1989) The theory of mind hypothesis of autism: a reply to Boucher. The British Journal of Disorders of Communication24: 199–200.
5.
Baron-CohenSWheelwrightSSkinnerR. (2001) The autism-spectrum quotient (AQ): evidence from Asperger syndrome/high-functioning autism, males and females, scientists and mathematicians. Journal of Autism and Developmental Disorders31: 5–17.
6.
BaumSHStevensonRAWallaceMT (2015a) Behavioral, perceptual, and neural alterations in sensory and multisensory function in autism spectrum disorder. Progress in Neurobiology134: 140–160.
7.
BaumSHStevensonRAWallaceMT (2015b) Testing sensory and multisensory function in children with autism spectrum disorder. Journal of Visualized Experiments (JoVE)98: e52677.
8.
BebkoJMSchroederJHWeissJA (2014) The McGurk effect in children with autism and Asperger syndrome. Autism Research7: 50–59.
9.
BebkoJMWeissJADemarkJL. (2006) Discrimination of temporal synchrony in intermodal events by children with autism and children with developmental disabilities without autism. Journal of Child Psychology and Psychiatry47: 88–98.
10.
BlackKRStevensonRASegersM. (submitted) Linking anxiety and insistence on sameness in children with autism: the role of hypersensitivity.
11.
BrainardDH. (1997) The psychophysics toolbox. Spatial Vision10: 433–436.
12.
BrockJBrownCCBoucherJ. (2002) The temporal binding deficit hypothesis of autism. Development and Psychopathology14: 209–224.
13.
BurnetteCPMundyPCMeyerJA. (2005) Weak central coherence and its relations to theory of mind and anxiety in autism. Journal of Autism and Developmental Disorders35: 63–73.
14.
CalvertGAThesenT (2004) Multisensory integration: methodological approaches and emerging principles in the human brain. Journal of Physiology98: 191–205.
15.
CheungOSRichlerJJPalmeriTJ. (2008) Revisiting the role of spatial frequencies in the holistic processing of faces. Journal of Experimental Psychology: Human Perception and Performance34: 1327.
16.
CollignonOCharbonneauGPetersF. (2013) Reduced multisensory facilitation in persons with autism. Cortex: A Journal Devoted to the Study of the Nervous System and Behavior49: 1704–1710.
17.
ConreyBPisoniDB (2006) Auditory-visual speech perception and synchrony detection for speech and nonspeech signals. The Journal of the Acoustical Society of America119: 4065–4073.
18.
CorbettBAConstantineLJHendrenR. (2009) Examining executive functioning in children with autism spectrum disorder, attention deficit hyperactivity disorder and typical development. Psychiatry Research166: 210–222.
19.
DawsonGWatlingR (2000) Interventions to facilitate auditory, visual, and motor integration in autism: a review of the evidence. Journal of Autism and Developmental Disorders30: 415–421.
20.
De Boer-SchellekensLEussenMVroomenJ (2013) Diminished sensitivity of audiovisual temporal order in autism spectrum disorder. Frontiers in Integrative Neuroscience7: 8.
21.
De GelderBVroomenJVan der HeideL (1991) Face recognition and lip-reading in autism. European Journal of Cognitive Psychology3: 69–86.
22.
DixonNFSpitzL (1980) The detection of auditory visual desynchrony. Perception9: 719–721.
23.
Foss-FeigJHKwakyeLDCascioCJ. (2010) An extended multisensory temporal binding window in autism spectrum disorders. Experimental Brain Research203: 381–389.
24.
FoxeJJMolholmSDel BeneVA. (2013) Severe multisensory speech integration deficits in high-functioning school-aged children with autism spectrum disorder (ASD) and their resolution during early adolescence. Cerebral Cortex25(2): 98–312.
25.
FraserSGagneJPAlepinsM. (2010) Evaluating the effort expended to understand speech in noise using a dual-task paradigm: the effects of providing visual speech cues. Journal of Speech, Language, and Hearing Research (JSLHR)53: 18–33.
26.
FrithUHappeF (1994) Autism: beyond “theory of mind.”Cognition50: 115–132.
27.
GauthierIKlaimanCSchultzRT (2009) Face composite effects reveal abnormal face processing in Autism spectrum disorders. Vision Research49: 470–478.
28.
GlodMRibyDMHoneyE. (2015) Psychological correlates of sensory processing patterns in individuals with autism spectrum disorder: a systematic review. Review Journal of Autism and Developmental Disorders2: 199–221.
29.
GreenSABen-SassonA (2010) Anxiety disorders and sensory over-responsivity in children with autism spectrum disorders: is there a causal relationship?Journal of Autism and Developmental Disorders40: 1495–1504.
30.
GreenSABen-SassonASotoTW. (2012) Anxiety and sensory over-responsivity in toddlers with autism spectrum disorders: bidirectional effects across time. Journal of Autism and Developmental Disorders42: 1112–1119.
31.
GrossmanRBSchnepsMHTager-FlusbergH (2009) Slipped lips: onset asynchrony detection of auditory-visual language in autism. Journal of Child Psychology and Psychiatry50: 491–497.
32.
GrossmanRBSteinhartEMitchellT. (2015) “Look who’s talking!” gaze patterns for implicit and explicit audio-visual speech synchrony detection in children with high-functioning autism. Autism Research8(3): 307–316.
33.
HappeF (1999) Autism: cognitive deficit or cognitive style?Trends in Cognitive Sciences3: 216–222.
34.
HillockARPowersARWallaceMT (2011) Binding of sights and sounds: age-related changes in multisensory temporal processing. Neuropsychologia49: 461–467.
35.
IarocciGRomboughAYagerJ. (2010) Visual influences on speech perception in children with autism. Autism14: 305–320.
IrwinJRTornatoreLABrancazioL. (2011) Can children with autism spectrum disorders “hear” a speaking face?Child Development82: 1397–1403.
38.
KannerL (1943) Autistic disturbances of affective contact. Nervous Child2: 217–250.
39.
KasariCSigmanM (1997) Linking parental perceptions to interactions in young children with autism. Journal of Autism and Developmental Disorders27: 39–57.
40.
KeaneBPRosenthalOChunNH. (2010) Audiovisual integration in high functioning adults with autism. Research in Autism Spectrum Disorders4: 276–289.
41.
KeetelsMVroomenJ (2005) The role of spatial disparity and hemifields in audio-visual temporal order judgments. Experimental Brain Research167: 635–640.
42.
KennyLHattersleyCMolinsB. (2015) Which terms should be used to describe autism? Perspectives from the UK autism community. Autism20: 442–462.
43.
KernJKTrivediMHGrannemannBD. (2007) Sensory correlations in autism. Autism11: 123–134.
44.
KientzMADunnW (1997) A comparison of the performance of children with and without autism on the Sensory Profile. American Journal of Occupational Therapy51: 530–537.
45.
KwakyeLDFoss-FeigJHCascioCJ. (2011) Altered auditory and multisensory temporal processing in autism spectrum disorders. Frontiers in Integrative Neuroscience4: 129.
46.
LachsLHernandezLR (1998) Update: the Hoosier audiovisual multitalker database. In: PisoniDB (ed.) Research on Spoken Language Processing. Bloomington, IN: Speech Research Laboratory, Indiana University, pp.377–388.
47.
Le CouteurARutterMLordC. (1989) Autism diagnostic interview: a standardized investigator-based instrument. Journal of Autism and Developmental Disorders19: 363–387.
48.
LidstoneJUljarevićMSullivanJ. (2014) Relations among restricted and repetitive behaviors, anxiety and sensory features in children with autism spectrum disorders. Research in Autism Spectrum Disorders8: 82–92.
49.
LordC (1995) Follow-up of two-year-olds referred for possible autism. Journal of Child Psychology and Psychiatry36: 1365–1382.
50.
LordCRutterMDiLavorePC. (2012) Autism Diagnostic Observation Schedule: ADOS-2. Los Angeles, CA: Western Psychological Services.
51.
LucePAPisoniDB (1998) Recognizing spoken words: the neighborhood activation model. Ear and Hearing19: 1–36.
52.
MacalusoEGeorgeNDolanR. (2004) Spatial and temporal factors during processing of audiovisual speech: a PET study. NeuroImage21: 725–732.
53.
McGurkHMacDonaldJ (1976) Hearing lips and seeing voices. Nature264: 746–748.
54.
MeredithMASteinBE (1986) Spatial factors determine the activity of multisensory neurons in cat superior colliculus. Brain Research365: 350–354.
55.
MeredithMANemitzJWSteinBE (1987) Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors. Journal of Neuroscience7: 3215–3229.
56.
MeredithMAWallaceMTSteinBE (1992) Visual, auditory and somatosensory convergence in output neurons of the cat superior colliculus: multisensory properties of the tecto-reticulo-spinal projection. Experimental Brain Research88: 181–186.
57.
MillerLMD’EspositoM (2005) Perceptual fusion and stimulus coincidence in the cross-modal integration of speech. Journal of Neuroscience25: 5884–5893.
58.
MongilloEIrwinJWhalenD. (2008) Audiovisual processing in children with and without autism spectrum disorders. Journal of Autism and Developmental Disorders38: 1349–1358.
59.
MottronLBurackJA (2001) Enhanced perceptual functioning in the development of autism. In: BurackJACharmanTYirmiyaN. (eds) The Development of Autism: Perspectives from Theory and Research. Mahwah, NJ: Lawrence Erlbaum Associates, pp.131–148.
60.
MottronLBurackJAIarocciG. (2003) Locally oriented perception with intact global processing among adolescents with high-functioning autism: evidence from multiple paradigms. Journal of Child Psychology and Psychiatry44: 904–913.
61.
MottronLDawsonMSoulieresI. (2006) Enhanced perceptual functioning in autism: an update, and eight principles of autistic perception. Journal of Autism and Developmental Disorders36: 27–43.
62.
NavonD (1977) Forest before trees: the precedence of global features in visual perception. Cognitive Psychology9: 353–383.
63.
NishimuraMRutherfordMMaurerD (2008) Converging evidence of configural processing of faces in high-functioning adults with autism spectrum disorders. Visual Cognition16: 859–891.
O’NeillMJonesRS (1997) Sensory-perceptual abnormalities in autism: a case for more research?Journal of Autism and Developmental Disorders27: 283–293.
66.
OzonoffSPenningtonBFRogersSJ (1991) Executive function deficits in high-functioning autistic individuals: relationship to theory of mind. Journal of Child Psychology and Psychiatry32: 1081–1105.
67.
PattenEWatsonLRBaranekGT (2014) Temporal synchrony detection and associations with language in young children with ASD. Autism Research and Treatment2014: 1–8.
68.
PelliDG. (1997) The VideoToolbox software for visual psychophysics: transforming numbers into movies. Spatial Vision10: 437–442.
69.
PellicanoEBurrD (2012) When the world becomes “too real”: a Bayesian explanation of autistic perception. Trends in Cognitive Sciences16: 504–510.
70.
PlaistedKSwettenhamJReesL (1999) Children with autism show local precedence in a divided attention task and global precedence in a selective attention task. Journal of Child Psychology and Psychiatry40: 733–742.
71.
PowersAR3rdHeveyMAWallaceMT (2012) Neural correlates of multisensory perceptual learning. Journal of Neuroscience32: 6263–6274.
72.
PowersAR3rdHillockARWallaceMT (2009) Perceptual training narrows the temporal window of multisensory binding. Journal of Neuroscience29: 12265–12274.
73.
PreacherKJHayesAF (2004) SPSS and SAS procedures for estimating indirect effects in simple mediation models. Behavior Research Methods, Instruments, & Computers36: 717–731.
74.
QuintoLThompsonWFRussoFA. (2010) A comparison of the McGurk effect for spoken and sung syllables. Attention, Perception & Psychophysics72: 1450–1454.
75.
RogersSJHepburnSWehnerE (2003) Parent reports of sensory symptoms in toddlers with autism and those with other developmental disorders. Journal of Autism and Developmental Disorders33: 631–642.
76.
RoyalDWCarriereBNWallaceMT (2009) Spatiotemporal architecture of cortical receptive fields and its impact on multisensory interactions. Experimental Brain Research198: 127–136.
77.
SamsonFMottronLJemelB. (2006) Can spectro-temporal complexity explain the autistic pattern of performance on auditory tasks?Journal of Autism and Developmental Disorders36: 65–76.
78.
SchallSQuigleyCOnatS. (2009) Visual stimulus locking of EEG is modulated by temporal congruency of auditory stimuli. Experimental Brain Research198: 137–151.
79.
SchlesingerJJStevensonRAShotwellMS. (2014) Improving pulse oximetry pitch perception with multisensory perceptual training. Anesthesia and Analgesia118: 1249–1253.
80.
SenkowskiDTalsmaDGrigutschM. (2007) Good times for multisensory integration: effects of the precision of temporal synchrony as revealed by gamma-band oscillations. Neuropsychologia45: 561–571.
81.
ShamsLKamitaniYShimojoS (2000) Illusions: what you see is what you hear. Nature408: 788.
82.
SheffertSMLachsLHernandezLR (1996) The Hooiser audiovisual multitalker database. In: PisoniDB (ed.) Research on Spoken Language Processing. Bloomington, IN: Speech Research Laboratory, Indiana University, pp. 578–583.
SinhaPKjelgaardMMGandhiTK. (2014) Autism as a disorder of prediction. Proceedings of the National Academy of Sciences of the United States of America111: 15220–15225.
85.
SmithEGBennettoL (2007) Audiovisual speech integration and lipreading in autism. Journal of Child Psychology and Psychiatry48: 813–821.
86.
StevensSS (1946) On the theory of scales of measurement. Science103: 677–680.
StevensonRAJamesTW (2009) Audiovisual integration in human superior temporal sulcus: inverse effectiveness and the neural processing of speech and object recognition. NeuroImage44: 1210–1223.
StevensonRABaumSHSegersS. (2017). Multisensory speech perception in autism spectrum disorder: from phoneme to whole-word perception. Autism Research. Epub ahead of print 24March2017. DOI: 10.1002/aur.1776.
91.
StevensonRABushmakinMKimS. (2012a) Inverse effectiveness and multisensory interactions in visual event-related potentials with audiovisual speech. Brain Topography25: 308–326.
92.
StevensonRAGeogheganMLJamesTW (2007) Superadditive BOLD activation in superior temporal sulcus with threshold non-speech objects. Experimental Brain Research179: 85–95.
93.
StevensonRAGhoseDFisterJK. (2014a) Identifying and quantifying multisensory integration: a tutorial review. Brain Topography27: 707–730.
94.
StevensonRAKimSJamesTW (2009) An additive-factors design to disambiguate neuronal and areal convergence: measuring multisensory interactions between audio, visual, and haptic sensory streams using fMRI. Experimental Brain Research198: 183–194.
95.
StevensonRANelmsCEBaumSH. (2015a) Deficits in audiovisual speech perception in normal aging emerge at the level of whole-word recognition. Neurobiology of Aging36: 283–291.
96.
StevensonRASegersMFerberS. (2014b) The impact of multisensory integration deficits on speech perception in children with autism spectrum disorders. Frontiers in Psychology5: 379.
97.
StevensonRASegersMFerberS. (2015b) Keeping time in the brain: autism spectrum disorder and audiovisual temporal processing. Autism Research9(7): 720–738.
98.
StevensonRASiemannJKSchneiderBC. (2014c) Multisensory temporal integration in autism spectrum disorders. Journal of Neuroscience34: 691–697.
99.
StevensonRASiemannJKWoynaroskiTG. (2014d) Brief report: arrested development of audiovisual speech perception in autism spectrum disorders. Journal of Autism and Developmental Disorders44: 1470–1477.
100.
StevensonRASiemannJKWoynaroskiTG. (2014e) Evidence for diminished multisensory integration in autism spectrum disorders. Journal of Autism and Developmental Disorders44: 3161–3167.
101.
StevensonRASunSZHazlettN. (2016) Seeing the forest and the trees: default local processing in individuals with high autistic traits does not come at the expense of global attention. Journal of Autism and Developmental Disorders. Epub ahead of print 9February2016. DOI: 10.1007/s10803-016-2711-y.
StevensonRAWilsonMMPowersAR. (2013) The effects of visual training on multisensory temporal processing. Experimental Brain Research225: 479–489.
104.
StevensonRAZemtsovRKWallaceMT (2012b) Individual differences in the multisensory temporal binding window predict susceptibility to audiovisual illusions. Journal of Experimental Psychology: Human Perception and Performance38: 1517–1529.
105.
SumbyWHPollackI (1954) Visual contribution to speech intelligibility in noise. Journal of the Acoustical Society of America26: 212–215.
106.
Talay-OnganAWoodK (2000) Unusual sensory sensitivities in autism: a possible crossroads. International Journal of Disability and Developmental Education47: 201–212.
107.
TeunisseJ-PDe GelderB (2003) Face processing in adolescents with autistic disorder: the inversion and composite effects. Brain and Cognition52: 285–294.
108.
Van AtteveldtNMFormisanoEBlomertL. (2007) The effect of temporal asynchrony on the multisensory integration of letters and speech sounds. Cerebral Cortex17: 962–974.
109.
Van BoxtelJJLuH (2013) A predictive coding perspective on autism spectrum disorders. Frontiers in Psychology4: 19.
110.
Van de CruysSEversKVan der HallenR. (2014) Precise minds in uncertain worlds: predictive coding in autism. Psychological Review121: 649–675.
111.
Van der SmagtMJvan EngelandHKemnerC (2007) Brief report: can you see what is not there? low-level auditory-visual integration in autism spectrum disorder. Journal of Autism and Developmental Disorders37: 2014–2019.
112.
Van WassenhoveVGrantKWPoeppelD (2007) Temporal window of integration in auditory-visual speech perception. Neuropsychologia45: 598–607.
113.
WallaceMTStevensonRA (2014) The construct of the multisensory temporal binding window and its dysregulation in developmental disabilities. Neuropsychologia64C: 105–123.
114.
WallaceMTRobersonGEHairstonWD. (2004) Unifying multisensory signals across time and space. Experimental Brain Research158: 252–258.
115.
WatlingRLDeitzJWhiteO (2001) Comparison of Sensory Profile scores of young children with and without autism spectrum disorders. American Journal of Occupational Therapy55: 416–423.
116.
WechslerDHsiao-pinC (2011) WASI-II: Wechsler Abbreviated Scale of Intelligence. Upper Saddle River, NJ: Pearson.
117.
WilliamsJMassaroDWPeelNJ. (2004) Visual-auditory integration during speech imitation in autism. Research in Developmental Disabilities25: 559–575.
118.
WingLPotterD (2002) The epidemiology of autistic spectrum disorders: is the prevalence rising?Mental Retardation and Developmental Disabilities Research Reviews8: 151–161.
119.
WoynaroskiTGKwakyeLDFoss-FeigJH. (2013) Multisensory speech perception in children with autism spectrum disorders. Journal of Autism and Developmental Disorders43: 2891–2902.
120.
YoungAWHellawellDHayDC (1987) Configurational information in face perception. Perception16: 747–759.
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
