On-screen keyboard controlled by gaze for Vietnamese people with amyotrophic lateral sclerosis

Abstract

BACKGROUND:

On-screen keyboard controlled by gaze is the most useful approach to help people with Amyotrophic Lateral Sclerosis (ALS) communicate. However, the design of the traditional on-screen keyboard hinders gaze typing for languages other than English.

OBJECTIVE:

The purpose of this paper is developing a specialized on-screen keyboard controlled by gaze for Vietnamese people with ALS.

METHODS:

Designed on-screen keyboard layouts and selection mechanism based on the requirements of eye typing and Vietnamese language characteristics from the statistics results on the Vietnamese Wikipedia Corpus dataset. During the experiment, we also absorbed and modified some design features according to the users’ suggestions.

RESULTS:

The authors proposed two new specialized on-screen keyboard layouts controlled by eye gaze for the Vietnamese language which both speed up typing and reduce typos. The results of the experiment are an average typing speed of respectively 23.1 and 26.1 characters per minute, and an average error rate of 1.0% and 0.5% for the two layouts. All participants were satisfied when using the system at their house.

CONCLUSIONS:

Although the effectiveness of the proposed method depends on the time of use and the familiarity of users with the new keyboard, the potential of the proposed method is great.

Keywords

Human-computer interaction augmentative communication on-screen keyboard interaction design;eye tracking

Get full access to this article

View all access options for this article.

References

Calvo

Chio

Castellina

Corno

Farinetti

Ghiglione

Pasian

Vignola

. Eye tracking impact on Quality-of-life of ALS Patients. In: 11th International Conference on Computers Helping People with Special Needs tenutosi a Linz (AT). 2008 July. pp. 70-77.

Zhai

Smith

. Alphabetically biased virtual keyboards are easier to use: layout does matter. Extended Abstracts on Human Factors in Computing Systems. 2001; 321-322.

Mackenzie

Zhang

Soukoreff

. Text entry using soft keyboards. Behaviour & Information Technology. 1999; 18(4): 235-244.

Zhai

Hunter

Smith

. Performance Optimization of Virtual Keyboards. Human-computer Interaction. 2002; 17(2-3): 229-269.

Gomide

Loja

LFB

Lemos

Flores

Melo

Teixeira

RAG

. A new concept of assistive virtual keyboards based on a systematic review of text entry optimization techniques. Research on Biomedical Engineering. 2016; 32(2): 176-198. doi: 10.1590/2446-4740.01715.

Raupp

. Keyboard layout in eye gaze communication access: typical vs ALS (Doctoral Dissertation, East Carolina University). 2013 January.

Yagi

. Eye-gaze interfaces using electro-oculography (EOG). In: International Conference on Intelligent User Interfaces, Proceedings IUI. 2010.

Liu

Rawicz

Zhang

Lin

Rezaei

. An Eye-Gaze Tracking and Human Computer Interface System for People with ALS and Other Locked-in Diseases. Journal of Medical and Biological Engineering. 2012; 32(2): 111-116.

Morimoto

Mimica

MRM

. Eye gaze tracking techniques for interactive applications. Computer Vision and Image Understanding. 2005; 98(1): 4-24.

10.

Feit

Williams

Toledo

Paradiso

Kulkarni

Kane

Morris

. Toward Everyday Gaze Input: Accuracy and Precision of Eye Tracking and Implications for Design. In: CHI ’17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 2017. pp. 1118-1130.

11.

Rivera

Molina

Gómez

Merino

. A Study of Two-inputs Scanning Methods to Enhance the Communication Rate. In: Assistive Technology from Adapted Equipment to Inclusive Environments. IOS Press; 2009. pp. 132-137.

12.

Bhattacharya

Samanta

Basu

. User errors on scanning keyboards: Empirical study, model and design principles. Interacting with Computers. 2008 May 1; 20(3): 406-18.

13.

Yang

Lin

Lee

. Design of virtual keyboard using blink control method for the severely disabled. Computer Methods and Programs in Biomedicine. 2013 Aug 1; 111(2): 410-418.

14.

Majaranta

Räihä

. Text Entry by Gaze: Utilizing Eye-Tracking. Text Entry Systems: Mobility, Accessibility, Universality. 2007; 175-187.

15.

Abe

Ohi

Ohyama

. An Eye-Gaze Input System Using Information on Eye Movement History. In: Universal Access in Human-Computer Interaction. Ambient Interaction, 4th International Conference on Universal Access in Human-Computer Interaction, UAHCI 2007. Berlin, Heidelberg: Springer; 2007.

16.

Ghosh

Sarcar

Sharma

Samanta

. Effective virtual keyboard design with size and space adaptation. In: 2010 IEEE Students Technology Symposium (TechSym). IEEE; 2010 Apr 3. pp. 262-267.

17.

Sharma

Sarcar

Saha

Samanta

. Visual clue: an approach to predict and highlight next character. In: 2012 4th International Conference on Intelligent Human Computer Interaction (IHCI). IEEE; 2012 Dec 27. pp. 1-7.

18.

Sharma

Dey

Saha

Samanta

. Parameters effecting the predictive virtual keyboard. In: 2010 IEEE Students Technology Symposium (TechSym). IEEE; 2010 Apr 3. pp. 268-275.

19.

Garay-Vitoria

Abascal

. Text prediction systems: A survey. Universal Access in the Information Society. 2006; 4: 188-203.

20.

ISO/IEC 9995-7:1994. Information technology – Keyboard layouts for text and office systems – Part 7: Symbols used to represent functions. 1994 Sep 15.

21.

TCVN 6064:1995. Information technology – Vietnammese keyboard layouts for office systems. 1995 August.

22.

Rhodes

. Dictionarium Annamiticum Lusitanum et Latinum Roma: Sacra Congregatio de Propaganda Fide. 1651.

23.

. Giáo Trình Lịch S Ng\̃uhorn m Ti\́ecircumflexng Vi\̣ecircumflext. Vietnam education publishing house; 1997.

24.

Anh

. Vietnamese Wikipedia Corpus. 2017. Available from: https://github.com/undertheseanlp/corpus.viwiki.

25.

Cedarbaum

Stambler

Malta

Fuller

Hilt

Thurmond

Nakanishi

Bdnf Als Study Group 1A complete listing of the BDNF Study Group . The ALSFRS-R: a revised ALS functional rating scale that incorporates assessments of respiratory function. Journal of the Neurological Sciences. 1999 Oct 31; 169(1-2): 13-21.