Developing a Prototype to Translate Text and Speech to Pakistan Sign Language With Bilingual Subtitles: A Framework

Abstract

The purpose of the study is to provide a literature review of the work done on sign language (SL) around the world and in Pakistan and to develop a translation tool of speech and text to Pakistan Sign Language (PSL) with bilingual subtitles. Information and communication technology and tools development for teaching and learning purposes improve the learning process and facilitate both teachers and students. In Pakistan, unimpaired people face a lot of problems to communicate with deaf people due to the lack of SL understanding, learning resources, and interpreters. This problem is faced by the teachers who communicate with deaf students in the classrooms. The communication gap is filled with the development of a translation tool as Haseeb and Illyas concluded in their study that using this kind of tool, deaf people will have more opportunities to communicate with other members of society at every level. Different components of technology such as Python programming language, Natural Language Tool Kit, prerecorded PSL videos, Linux-based server, and databases are used to develop the prototype of PSL translation tool. This study provides a literature review to highlight the existing technological work done around the world and in Pakistan and also provides an architectural framework of the PSL translation tool which is developed by the researchers to facilitate the people who face difficulty to communicate with deaf people.