Ergonomics and automatic speech recognition applications for deaf and hard-of-hearing users

Abstract

The potential of automatic speech recognition (ASR) for deaf and hard-of-hearing people has been recognized. This paper reviews the use environment for the deaf and hard-of-hearing person and an ASR device, using ergonomic analysis techniques. Within the deaf and hard-of-hearing population, there are many interpersonal differences, stemming from audiological and rehabilitation characteristics and social and occupational settings. Some members of the population may find ASR devices inadequate or prefer other communication aids. Environmental characteristics, particularly noise and light, affect ASR device use. The technology of automatic speech recognition itself introduces device limitations and challenges. In ergonomic analysis, these three aspects – user, environment and device – are connected by the task, in this case the communication task. Deaf and hard-of-hearing users need to communicate with many different people, ranging from intimate associates to perfect strangers and disembodied voices. They need to communicate in one-to-one situations and in groups both small and large. In many of these communication settings, relationships are more important than information and use of ASR would interfere with valuable eye contact as much as aid communication. Imposing order on many communication settings is problematic, but multiple conversations and interruptions create interference with selecting the correct signal to transcribe.