Effect of Synthetic Voice Intelligibility on Speech Comprehension

Abstract

This research investigated the differential impact of synthetic voice quality and text difficulty on comprehension of extended prose. Sixty participants listened to five easy and five difficult passages in one of three speech modes: natural speech, VOTRAX (low intelligibility), or DECtalk (high intelligibility). Comprehension of DECtalk was equal to that of natural speech, whereas comprehension of VOTRAX was significantly poorer than with natural speech or DECtalk. Subjects were also asked to shadow passages of each speech type as a measure of resource processing demands. It was found that shadowing accuracy was significantly better for natural speech than for DECtalk and shadowing of DECtalk was markedly superior to that of VOTRAX. The results of this study suggest that resource-demand measures alone may not be appropriate to predict performance in practical applications. Specifically, overall comprehension may not suffer despite on-line losses in processing. These findings also point to a differential allocation of cognitive resources by speech synthesizers of differing intelligibility.

Get full access to this article

View all access options for this article.

References

Gernsbacher, M. A. (1985). Surface information loss in comprehension.. Cognitive Psychology, 17, 324–363.

Glanzer, M. , Fischer, B. , and Dorfman, D. (1984). Short-term storage in reading.. Journal of Verbal Learning and Verbal Behavior, 23, 467–486.

Greene, B. G. , Logan, J. S. , and Pisoni, D. B. (1986). Perception of synthetic speech produced automatically by rule: Intelligibility of eight text-to-speech systems. Behavior Research Methods, Instruments, & Computers, IB, 100–107.

Jarvella, R. J. (1971). Syntactic processing of connected speech. Journal of Verbal Learning and Verbal Behavior, 10, 409–416.

Logan, J. S. , Greene, B. G. , and Pisani, D. B. (1989). Segmental intelligibility of synthetic speech produced by rule.. Journal of the Acoustical Society of America, 86, 566–581.

McCauley, M. E. (1984). Human factors in voice technology. In F. A. Muckler (Ed.), Human factors review (pp. 131–166). Santa Monica, CA: Human Factors and Ergonomics Society.

Pisoni, D. B. (1975). Auditory short-term memory vowel perception.. Memory and Cognition, 3, 7–18.

Pisoni, D. B. , Manous, L. M. , and Dedina, J. J. (1987). Comprehension of natural and synthetic speech: Effects of predictability on the verification of sentences controlled for intelligibility.. Computer Speech and Language, 2, 303–320.

Pisoni, D. B. , Nusbaum, H. C. , and Greene, B. G. (1985). Perception of synthetic speech generated by rule.. Proceedings of the IEEE, 73, 1665–1676.

10.

Ralston, J. V. , Pisoni, D. B. , Lively, S. E. , Greene, B. G. , and Mullennix, J. W. (1991). Comprehension of synthetic speech produced by rule: Word monitoring and sentenceby-sentence listening times.. Human Factors, 33, 471–491.

11.

Repp, B. H. (1983). Categorical perception: Issues, methods, findings. In N. J. Lass (Ed.), Speech and language: Advances in basic research and practice (Vol. 10). New York: Academic.

12.

Sachs, J. S. (1967). Recognition memory for syntactic and semantic aspects of connected discourse.. Perception & Psychophysics, 2, 437–442.