Correlation Between Gestures’ Qualitative Properties and Usa- bility metrics

Abstract

The choice of best gestures and commands for touchless interfaces is a critical step that determines the user- satisfaction and overall efficiency of surgeon computer interaction. In this regard, usability metrics such as task completion time, error rate, and memorability have a long-standing as potential entities in determining the best gesture vocabulary. In addition, some previous works concerned with this problem have utilized qualitative measures to identify the best gesture. In this work, we hypothesize that there is a correlation between the qualitative properties of gestures (v) and their usability metrics (u). Therefore, we conducted an experiment with linguists to quantify the properties of the gestures. Next, a user study was conducted with surgeons, and the usability metrics were measured. Lastly, linear and non-linear regression techniques were used to find the correlations between u and v. Results show that usability metrics are correlated with the gestures’ qualitative properties (R² = 0.4).

Get full access to this article

View all access options for this article.

References

Farhadi-niaki

Gerroir

Arya

Etemad

S. A.

Laganière

Payeur

Biddle

(2013). Usability Study of Static / Dynamic Gestures and Haptic Input as Interfaces to 3D Games, (c), 315–323.

Gonzalez

Madapana

Taneja

Zhang

(2018). Looking Beyond the Gesture : Vocabulary Acceptability Criteria for Gesture Elicitation Studies, 997–1001. https://doi.org/10.1177/1541931218621230

Graetzel

Fong

Grange

Baur

(2004). A Non- Contact Mouse for Surgeon-Computer Interaction, (May). https://doi.org/10.3233/THC-2004-12304

Jalaliniya

Smith

Sousa

Büthe

Pederson

(2013). Touch-less Interaction with Medical Images Using Hand & Foot Gestures, 1265–1274.

Kirishima

Sato

(2005). Real-Time Gesture Recognition by Learning and Selective Control of Visual Interest Points, 27(3), 351–364.

Madapana

Gonzalez

Rodgers

Zhang

Wachs

(2018). Gestures for Picture Archiving and Communication Systems ( PACS ) operation in the operating room : Is there any standard ?, 1–13.

Madapana

Gonzalez

Taneja

Rodgers

Zhang

Wachs

(2019). Preference elicitation : Obtaining gestural guidelines for PACS in neurosurgery. International Journal of Medical Informatics, 130(August 2018), 103934. https://doi.org/10.1016/j.ijmedinf.2019.07.013

Mewes

Saalfeld

Riabikin

Skalej

Hansen

(2015). A gesture-controlled projection display for CT- guided interventions. International Journal of Computer Assisted Radiology and Surgery. https://doi.org/10.1007/s11548-015-1215-0

Morris

M. R.

Wobbrock

J. O.

Wilson

A. D.

(2010). Understanding Users ’ Preferences for Surface Gestures, 261–268.

10.

Opromolla

Volpi

Ingrosso

Fabri

Rapuano

Passalacqua

Medaglia

C. M.

(2015). A Usability Study of a Gesture Recognition System Applied During the Surgical Procedures, 2, 682–692. https://doi.org/10.1007/978-3-319-20889-3

11.

Piumsomboon

Clark

Billinghurst

Clark

Billinghurst

Canterbury

(2013). User-Defined Gestures for Augmented Reality.

12.

Rosa

G. M.

Elizondo

M. L.

(2014). Use of a gesture user interface as a touchless image navigation system in dental surgery : Case series report.

13.

Soutschek

Penne

Hornegger

Kornhuber

(2008). 3-D Gesture-Based Scene Navigation in Medical Imaging Applications Using Time-Of-Flight Cameras Chair of Pattern Recognition, Department of Computer Science, 2–7.

14.

Spagnolo

A. M.

Ottria

Amicizia

Perdelli

Cristina

M. L.

(2013). Operating theatre quality and prevention of surgical site infections, 131–137.

15.

Spinuzzi

(2005). The Methodology of Participatory Design, (July).

16.

Stern

H. I.

Wachs

J. P.

Edan

(2008). Optimal Consensus Intuitive Hand Gesture Vocabulary Design, 105–112. https://doi.org/10.1109/ICSC.2008.29

17.

Tsai

T.-H.

Tseng

K. C.

Chang

Y.-S.

(2017). Testing the usability of smartphone surface gestures on different sizes of smartphones by different age groups of users.

18.

Vatavu

(2012). User-Defined Gestures for Free-Hand TV Control, 45–48.

19.

Wachs

Stern

Edan

Gilam

Handler

Feied

Smith

(2008). A Gesture-based Tool for Sterile Browsing of Radiology Images, 15(3), 321–323. https://doi.org/10.1197/jamia.M2410.Introduction

20.

Wachs

Stern

Edan

Gillam

Feied

Smith

Handler

(2006). A Real-Time Hand Gesture Interface for Medical Visualization Applications.

21.

Wang

L. L.

Leach

J. L.

Breneman

J. C.

Mcpherson

C. M.

Mary

(2014). Critical Role of Imaging in the Neurosurgical and Radiotherapeutic Management of Brain Tumors 1.