Speech Imitation in Simulated Deafness,Using Visual Cues and Recoded' Auditory Information

Abstract

A technique for the simulation of deafness, and its alleviation by a new " frequency transposition " device are described. The effects of visual cues (provided by the experimenter's articulatory movements), and of 'recoded' auditory information provided by the " frequency transposer "), on subjects' ability to make a 'judged match' imitation response to spoken CVC nonsense syllables, were evaluated. The improved imitation when visual cues were provided, of both " manner " of articulation (p < 0.01), and " place " of articulation (p < 0.001) of certain fricative, sibilant and stop consonants, together with a highly significant improvement in overall imitation scores (p << 0.0005), supported the conclusion that normal hearing subjects, although untrained in lipreading, had a well developed ability to ' integrate' auditory and visual speech information. Further, the improved imitation of both " manner " of articulation (p < 0.025), and " place " of articulation (p < 0.025), of certain fricative, sibilant and stop consonants brought about by ' recoding ' the speech signal (without any experimentally guided articulation or discrimination training) supported the hypothesis that the recoding technique would produce a signal which was sufficiently ' speech-like' to be utilised with effect by the ear-brain system, and may therefore be of use in the rehabilitation of the " perceptively " deaf.

Get full access to this article

View all access options for this article.

References

Brrild, K. ( 1967). Experience with the design and use of technical aids for the training of deaf and hard of hearing children. In Pickett, J. M. (ed.), Proc. Conf. Speech-Analysing Aids for the Deaf (Gallaudet College, Washington, D.C.), 168.

Broadbent, D.E. and Gregory, M. ( 1964). Accuracy of recognition for speech presented to the right and left ears. Quart. exp. Psychol., 16, 359.

Erber, N.P. ( 1969). Interaction of audition and vision in the recognition of oral speech stimuli. J. Speech Hear. Res. 12, 423.

Fletcher, H. ( 1958). Speech and Hearing in Communication ( New York).

Geldard, F. ( 1957). Adventures in tactile literacy. Amer. Psychol. 12, 115.

Geldard, F. ( 1960). Some neglected possibilities of communication . Science, 131, 1583.

Hudgins, C.V. ( 1935). Visual aids in correction of speech. Volta Rev., 37, 637 and 703.

Johansson, B. ( 1961). A new coding amplifier system for the severely hard of hearing. In Proc. Third Int. Congr. Acoust . (New York), 655.

Kimura, D. ( 1961). Cerebral dominance and the perception of verbal stimuli . Can. J. Psychol., 15, 166.

10.

Kringlebotn, M. ( 1967). Experiments with some visual and vibrotactile aids for the deaf. In Pickett, J. M. (ed.), Proc. Conf. Speech-Analysing Aids for the Deaf ( Gallaudet College, Washington, D.C.), 311.

11.

Krug, R.F. ( 1960). Effects and interactions of visual and auditory cues in oral communication. Ph.D dissertation, University of Oklahoma, L.C. card No. Mic 60 - 5189.

12.

Lenneberg, E.H. ( 1964). A biological perspective of language. In Lenneberg, E. H. (ed.), New Directions in the Study of Language (Cambridge, Mass.), 65.

13.

Lenneberg, E.H. ( 1967). Biological Foundations of Language ( New York).

14.

Liberman, A.M. , Cooper, F.S. , Harris, K.S. , Macneilage, P.F. and Studdert-Kennedy, M. ( 1967). Some observations on a model for speech perception . In Wathen-Dunn, W. (ed.), Models for the Perception of Speech and Visual Form (Cambridge , Mass.), 68.

15.

Liberman, A.M. , Harris, K.S. , Eimas, P. , Lisker, L. and Bastian, J. ( 1961). An effect of learning on speech perception : the discrimination of durations of silence with and without phonemic significance . Language and Speech, 4, 175.

16.

Ling, D. ( 1968). Auditory discrimination of coded speech by deaf children. Ph.D dissertation, Institute of Otolaryngology, McGill University.

17.

Martony, J. ( 1967). On the correction of the voice pitch level for severely hard of hearing subjects. In Pickett, J. M. (ed.), Proc. Conf. Speech-Analysing Aids for the Deaf ( Gallaudet College, Washington, D.C.), 195.

18.

Mecham, S.R. and Arbess, J. ( 1970). The effect of syllable repetition on an auditory discrimination task in deaf children. Paper delivered to Int. Congr. Educ. Deaf, Stockholm, August 17-21, 1970.

19.

Neeley, K. ( 1956). Effect of visual factors on the intelligibility of speech . J. acoust. Soc. Amer., 28, 1275.

20.

O'Neill, J.J. ( 1954). Contributions of the visual components of oral symbols to speech comprehension. J. Speech Hear. Dis., 19., 429.

21.

Peterson, G.E. ( 1970). The speech communication process. In Malmberg, B. (ed.), Manual of Phonetics ( Amsterdam), 153.

22.

Richards, D.L. and Berry, J. ( 1952). Tables for the generation of logatoms based on conversational speech. Research Report No. 13596, Post Office Research Station, London.

23.

Risberg, A. ( 1966). The transposer' and a model of speech perception . In Quart. Progr. & Status Rep., Speech Transmission Laboratory, Stockholm, STL-QPSR-4/1965.

24.

Risberg, A. ( 1967). Visual aids for speech correction. In Pickett, J. M. (ed.), Proc. Conf. Speech-Analysing Aids for the Deaf (Gallaudet College, Washington, D.C.), 178.

25.

Risberg, A. ( 1969). A critical review of work on speech analysing hearing aids. IEEE Trans. Audio & Electro-acoust., Vol. AU-17, No. 4, 290.

26.

Sanders, D.A. ( 1967). The relative contribution of the visual and auditory components of speech to speech intelligibility. In Int. Conf. Oral Educ, of the Deaf (Northampton, Mass.), Vol. 1, 865.

27.

Siegenthaler, B.M. and Gruber, V. ( 1969). Combining vision and audition for speech reception . J. Speech Hear. Dis., 34, 58.

28.

Sumby, W. and Pollock, I. ( 1954). Visual contributions to speech intelligibility . J. acoust. Soc. Amer. 26, 212.

29.

Webster, J.C. and Chaney, R.B. ( 1967). Information and complex signal perception. In Wathen-Dunn, W. (ed.), Models for the Perception of Speech and Visual Form (Cambridge , Mass.), 246.

30.

Whetnall, E. and Fry, D.B. ( 1964). The Deaf Child (Springfield , Ill.).