Using Natural Language Conventions in the User Interface Design of Automatic Speech Recognition Systems

Abstract

Four experiments were performed to examine how natural language conventions might be used to improve the user interface for systems using automatic speech recognition (ASR). Two new technological developments offered us this opportunity: word spotting permits recognition of key words embedded in extraneous speech; barge in permits the user to speak to the system while it plays instructional prompts. Our goal was to take advantage of natural language conventions to design an optimal prompting arrangement that would accommodate both novice and expert users. The conversational conventions we focused on included people's readiness to speak in response to a direct question and during an appropriately timed conversational pause. We studied these conventions in the context of an automated operator service. Our results indicated that a prompt-arranged as a leading question, followed by a brief pause and then a list of key words-met our goals for both the initial prompt and, if ASR failed. a subsequent reprompt. This approach resulted in fast, accurate responding, a user interface that received high user acceptance ratings, and an interface that was usable by both novice and expert users.

Get full access to this article

View all access options for this article.

References

Bennett, R. W. , Greenspan, S. L. , Syrdal, A. K. , Tschirgi, J. E. , and Wisowaty, J. J. (1989). Speaking to, from and through computers: Speech technologies and user interface design. AT&T Technical Journal, 68(5), 17–32.

Brooks, C. M. (1989, April/May). User interface design for speech recognition telephone applications. Speech Technology, 58–60.

Fay, D. (1993). Interfaces to automated telephone services: Do users prefer touchtone or automatic speech recognition? In Proceedings of Human Factors in Telecommunications Fourteenth International Symposium (pp. 339–349). Heidelberg, Germany: R. v. Decker.

Jones, D. M. , Frankish, C. R. , and Hapeshi, K. (1992). Automatic speech recognition in practice. Behaviour and Information Technology, II, 109–122.

Karis, D. , and Dobroth, K. M. (1991). Automating services with speech recognition over the public switched telephone network: Human factors considerations. IEEE Journal on Selected Areas in Communications, 9, 574–585.

Peckham, J. B. (1984). Automatic speech recognition-A solution in search of a problem?. Behaviour and Infonnation Technology, 3, 145–152.

Schwab, E. C. (1991). Human factors perspectives on automating alternate billing services. Presented at the Speech Tech Conference, New York.

Wattenbarger, B. L. , Garberg, R. B. , Halpern, E. S. , and Lively, B. L. (1993). Serving customers with automatic speech recognition-Human factors issues. AT&T Technica/Journal, 72(3), 28–41.