We developed a computerized audiovisual training programme for school-aged children with specific language impairment (SLI) to improve their phonological skills. The programme included various tasks requiring phonological decisions. Spoken words, pictures, letters and written syllables were used as training material. Spoken words were presented either as audiovisual speech (together with the talking face), or as auditory speech (voice alone). Two groups (10 children/group) trained for six weeks, five days per week: the audiovisual group trained with audiovisual speech, and the other group received analogically the same training but with auditory speech. Before and after training, language skills and other cognitive skills were assessed. The audiovisual group improved in a non-word-repetition test. Such improvement was not observed with auditory training. This result suggests that audiovisual speech may be helpful in the rehabilitation of children with SLI.
AlsiusAMöttönenRSamsMESoto-FaracoSTiippanaK (2014) Effect of attentional load on audiovisual speech perception: Evidence from ERPs. Frontiers in Psychology5.
2.
BernsteinLEAuerETJr.EberhardtSPJiangJ (2013) Auditory perceptual learning for speech perception can be enhanced by audiovisual training. Frontiers in Neuroscience7: 34.
3.
BernsteinLEberhardtSAuerE (2014) Audiovisual spoken word training can promote or impede auditory-only perceptual learning: Prelingually deafened adults with late-acquired cochlear implants versus normal hearing adults. Frontiers in Psychology5: 934.
4.
BosselerAMassaroD (2003) Development and evaluation of a computer-animated tutor for vocabulary and language learning in children with autism. Journal of Autism and Developmental Disorders33: 653–71.
5.
CoadyJEvansJ (2008) Uses and interpretations of non-word repetition tasks in children with and without specific language impairments (SLI). International Journal of Language and Communication Diseases43: 1–40.
6.
CrosseMJButlerJSLalorEC (2015) Congruent visual speech enhances cortical entrainment to continuous auditory speech in noise-free conditions. J Neuroscience35: 14195–204.
7.
DoddB (1979) Lip reading in infants: attention to speech presented in-and out-of-synchrony. Cognitive Psychology11: 487–84.
8.
ElbroCJensenM (2005) Quality of phonological representations, verbal learning and phoneme awareness in dyslexic and normal readers. Scandinavian Journal of Psychology46: 375–84.
9.
FilesBTTjanBSJiangJTBernsteinLE (2015) Visual speech discrimination and identification of natural and synthetic consonant stimuli. Frontiers in Psychology6: 878.
10.
FowlerA (1991) How early phonological development might set the stage for phoneme awareness. Haskins Laboratories Status Report on Speech Research SR105/106: 53–64.
11.
FranceschiniSTrevisanPRonconiLet al. (2017) Action video games improve reading abilities and visual-to auditory attentional shifting in English-speaking children with dyslexia. Scientific Reports7: 5863.
12.
FridrikssonJBakerJWhitesideJet al. (2009) Treating visual speech perception to improve speech production in nonfluent aphasia. Stroke40: 853–58.
13.
FrtusovaJPhillipsNWinnekeA (2013) ERP evidence that auditory-visual speech facilitates working memory in younger and older adults. Psychology and Aging28: 481.
14.
HardisonD (2003) Acquisition of second-language speech: effects of visual cues, context and talker variability. Applied Psycholinguistics24: 495–522.
15.
HazanVSennemaAIbaMFauklnerA (2005) Effect of audiovisual perceptual training on the perception and production of consonants by Japanese learners of English. Speech Communication47: 360–78.
16.
HeikkiläJLonkaEAholaSMeronenATiippanaK (2017) Lipreading ability and its cognitive correlates in typically developing children and children with specific language impairment (SLI). Journal of Speech, Language and Hearing Research60: 485–93.
17.
HeikkiläJTiippanaK (2016) School-aged children can benefit from audiovisual semantic congruency during memory encoding. Experimental Brain Research234: 1199–1207.
18.
HirataYKellySD (2010) Effects of lips and hands on auditory learning of second-language speech sounds. Journal of Speech, Language, and Hearing Research53: 298–310.
19.
IrwinJRBrancazioL (2014) Seeing to hear? Patterns of gaze to speaking faces in children with autism spectrum disorders. Frontiers in Psychology5: 397.
20.
IrwinJRPrestonJBrancazioLD’AngeloMTurciosJ (2015) Development of an audiovisual speech perception app for children with autism spectrum disorders. Clinical Linguistics and Phonetics29: 76–83.
21.
IrwinJTornatoreLBrancazioLWhalenD (2011) Can children with autism spectrum disorders ‘hear’ a speaking face?Child Development82: 1397–1403.
22.
KaplanEGoodglassHWeintraubS (1983) Boston Naming Test. Philadelphia, PA: Lea and Febiger.
KimRSSeitzARShamsL (2008) Benefits of stimulus congruency for multisensory facilitation of visual learning. PLoS ONE3: e1532.
25.
KnowlandVEvansSSnellCRosenS (2016) Visual speech perception in children with language learning impairments. Journal of Speech, Language and Hearing Research59: 1–14.
26.
KorkmanMKirkUKempSL (1997) NEPSY, Lasten Neuropsykologinen Tutkimus [The assessment of neuropsychological abilities in children]. Helsinki: Psykologien Kustannus.
27.
KorkmanMKirkUKempSL (2008) NEPSY-II, Lasten Neuropsykologinen Tutkimus[The assessment of neuropsychological abilities in children]. Helsinki: Psykologien Kustannus.
28.
KuhlPMeltzoffA (1982) The bimodal perception of speech in infancy. Science218: 1138–41.
29.
LawJBoyleJHarrisFHarknesANyeC (1998) Screening for speech and language delay: A systematic review of the literature. Health Technology Assessment, 2: 1–184.
30.
LeonardL (2014) Children with specific language impairment. Cambridge, MA: MIT Press.
31.
LewkowiczDJHansen-TiftA (2012) Infants deploy selective attention to the mouth of a talking face when learning speech. Proceedings of the National Academy of Sciences109: 1431–36.
32.
LeybaertJMacchiLHuyseAet al. (2014) Atypical audio-visual speech perception and McGurk effects in children with specific language impairment. Frontiers in Psychology5.
33.
LiYWangGLongJet al. (2011) Reproducibility and discriminability of brain patterns of semantic categories enhanced by congruent audiovisual stimuli. PLoS ONE6: e20801.
34.
LidestamBMoradiSPetterssonRRicklefsT (2014) Audiovisual training is better than auditory-only training for auditory-only speech-in-noise identification. Journal of the Acoustical Society of America136: EL142–47.
35.
LovioRHalttunenALyytinenHNäätänenRKujalaT (2012) Reading skill and neural processing accuracy improvement after a 3-hour intervention in preschoolers with difficulties in reading-related skills. Brain Research1448: 42–55.
36.
MacDonaldJMcGurkH (1978) Visual influences on speech perception processes. Perception and Psychophysics24: 253–57.
37.
MassaroDWLightJ (2004) Using visible speech to train perception and production of speech for individuals with hearing loss. Journal of Speech, Language, and Hearing Research47: 304–20.
38.
MassaroDWThompsonLABarronBLarenE (1986) Developmental changes in visual and auditory contributions to speech perception. Journal of Experimental Child Psychology41: 93–113.
39.
McGurkHMacDonaldJ (1976) Hearing lips and seeing voices. Nature264: 746–48.
40.
MeronenATiippanaKWesterholmJAhonenT (2013) Audiovisual speech perception in children with developmental language disorder in degraded listening conditions. Journal of Speech, Language and Hearing Research56: 211–21.
41.
MoradiSWahlinAHällgrenMRönnbergJLidestamB (2017) The efficacy of short-term gated audiovisual speech training for improving auditory sentence identification in noise in elderly hearing aid users. Frontiers in Psychology8: 368.
42.
MurrayJThomsonM (2011) Age-related differences in cognitive overload in an audio-visual memory task. European Journal of Psychology of Education26: 129–41.
43.
NewburyDBishopDMonacoA (2005) Genetic influences on language impairment and phonological short-term memory. Trends in Cognitive Science9: 528–34.
44.
NorburyCFThomplinJBBishopD (2008) Understanding developmental language disorders: From theory to practice. Oxford: Psychology Press.
45.
NorrixLPlanteEVanceRBoliekC (2007) Auditory-visual integration of speech in children with and without specific language impairment. Journal of Speech, Language and Hearing Research50: 1639 –51.
46.
PedroCLousadaMHallAJesusL (2018) Visual stimuli in intervention approaches for pre-schoolers diagnosed with phonological delay. Logopedics Phoniatrics Vocolocy43: 20–31.
47.
PremingerJZieglerC (2008) Can auditory and visual speech perception be trained within a group setting?American Journal of Audiology17: 80–97.
48.
RavenJRavenJCCourtJH (1998) Coloured progressive matrices. San Antonio, TX: Pearson.
49.
RichieCKewley-PortD (2008) The effects of auditory-visual vowel identification training on speech recognition under difficult listening conditions. Journal of Speech, Language, and Hearing Research51: 1607–19.
50.
RossLAMolholmSBlancoDet al. (2011) The development of multisensory speech perception continues into the late childhood years. European Journal of Neuroscience33: 2329–37.
51.
RossLSaint-AmourDLeavittVJavittDFoxeJ (2007) Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments. Cerebral Cortex17: 1147–53.
52.
RossionBPourtoisG (2004) Revisiting Snodgrass and Vanderwart’s object set: The role of surface detail in basic-level object recognition. Perception33: 217–36.
53.
SekiyamaKBurnhamD (2008) Impact of language development of auditory-visual speech perception. Developmental Science11: 306–20.
54.
ShamsLWoznyDRKimRSeitzAR (2011) Influences of multisensory experience on subsequent unisensory processing. Frontiers in Psychology2: 264.
55.
SkipperJNusbaumHSmalleS (2005) Listening to talking faces: motor cortical activation during speech perception. Neuroimage25: 76–89.
56.
SnowlingMChiatSHulmeS (1991) Words, non-words and phonological processes: Some comments on Gathercole, Willis, Emslie and Baddeley. Applied Psycholinguistics21: 369–73.
57.
Specific Language Impairment. Current Care Guidelines (Käypä Hoito) (2010) Working group set up by the Finnish Medical Society Duodecim, Finnish Phoniatricians (Suomen Foniatrit Ry) and Finnish Association of Pediatric Neurology. Helsinki: The Finnish Medical Society Duodecim. Available at: www.kaypahoito.fi (accessed July 2018).
58.
SumbyWHPollackI (1954) Visual contribution to speech intelligibility in noise. The Journal of the Acoustical Society of America26: 212–15.
59.
SwanDGoswamiU (1997) Phonological awareness deficits in developmental dyslexia and the phonological representation hypothesis. Journal of Experimental Child Psychology66: 18–41.
60.
TiippanaK (2014) What is the McGurk effect?Frontiers in Psychology5: 725.
61.
TiippanaKPuharinenHMöttönenRSamsM (2011) Sound location influences audiovisual speech perception when spatial attention is manipulated. Seeing and Perceiving24: 67–90.
62.
TomblinJRecordsNBuckwaterP (1997) Prevalence of specific language impairment in kindergarten children. Journal of Speech, Language and Hearing Research40: 1245–60.
63.
TomblinJRecordsNZhangX (1996) A system for the diagnosis of specific language impairment in kindergarten children. Journal of Speech, Language and Hearing Research39: 1284–94.
64.
WatkinsKStrafellaAPausT (2003) Seeing and hearing speech excites the motor system involved in speech production. Neuropsychologia41: 989–94.
65.
WebsterRShevellM (2004) Neurobiology of specific language impairment. Journal of Child Neurology19: 471–81.
Zion GolumbicECoganGBSchroederCEPoeppelD (2013) Visual input enhances selective speech envelope tracking in a auditory cortex at a ‘Cocktail Party’. Journal of Neuroscience33: 1417–26.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
