Using Gesture,Gaze,and Combination Input Schemes as Alternatives to the Computer Mouse

Abstract

Novel input devices can increase the bandwidth between users and their devices. Traditional desktop computing uses windows, icons, menus, and pointers – an interface built for the computer mouse and very effective for pointing-and-clicking. Alternative devices provide a variety of interactions including touch-free, gesture-based input and gaze-tracking to determine the user’s on-screen gaze location, but these input channels are not well-suited to a point-and-click interface. This study evaluates five new schemes, some multi-modal. These experimental schemes perform worse than mouse-based input for a picture sorting task, and motion-based gesture control creates more errors. Some gaze-based input has similar performance to the mouse while not creating additional workload.

Get full access to this article

View all access options for this article.

References

Bachmann

Weichert

Rinkenauer

(2014). Evaluation of the leap motion controller as a new contact-free pointing device. Sensors, 15(1), 214-233.

Canare

Chaparro

(2015, August). A comparison of gaze-based and gesture-based input for a point-and-click task. In International Conference on Universal Access in Human-Computer Interaction (pp. 15-24). Springer International Publishing.

Chatterjee

Xiao

Harrison

(2015, November). Gaze+Gesture: Expressive, Precise and Targeted Free-Space Interactions. In Proceedings of the 2015 ACM on International Conference on Multimodal Interaction (pp. 131-138). ACM.

Foster

(2013, July 22). Will These Guys Kill the Computer Interface as We Know It? Retrieved June 06, 2017, from http://www.popsci.com/technology/article/2013-07/will-these-guys-kill-computer-interface-we-know-it.

Jacob

Robert JK

. “The use of eye movements in human-computer interaction techniques: what you look at is what you get.” ACM Transactions on Information Systems (TOIS) 9.2 (1991): 152-169.

Kosunen

Jylha

Ahmed

Chech

Gamberini

… Jacucci

(2013, October). Comparing eye and gesture pointing to drag items on large screens. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces (pp. 425-428). ACM.

Kumar

Paepcke

Winograd

(2007, April). EyePoint: practical pointing and selection using gaze and keyboard. In Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 421-430). ACM.

Richardson

N. M.

(2013, May 28). One Giant Leap for Mankind. Retrieved June 06, 2017, from https://www.inc.com/30under30/nicole-marie-richardson/leap-motion-david-holz-michael-buckwald-2013.html

San Agustin

Mateo

J. C.

Hansen

J. P.

Villanueva

. (2009).Evaluation of the potential of gaze input for game interaction. PsychNology Journal, 7(2), 213-236.

10.

Savage

(2013). More than a mouse. Communications of the ACM, 56(11), 15-16.

11.

Seixas

Cardoso

Dias

M. T. G.

(2015). One hand or two hands? 2D selection tasks with the leap motion device.

12.

Stellmach

Dachselt

(2012, May). Look & touch: gaze-supported target acquisition. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 2981-2990). ACM.

13.

Zhai

(2003). What’s in the eyes for attentive input. Communications of the ACM, 46(3), 34-39.

14.

Zhang

Stellmach

Sellen

Blake

(2015, September). The costs and benefits of combining gaze and hand gestures for remote interaction. In Human-Computer Interaction (pp. 570-577). Springer International Publishing.