A novel approach for usability evaluation of mobile applications

Abstract

Mobile applications (apps) have been massively developed and released in recent years. In this competitive market, the users’ adoption of the app or satisfaction greatly depends on its usability. Therefore, tech companies and app developers are looking for quick and easy approaches to evaluate the usability of their products early in the design cycle. The objective of this study was to introduce a novel approach combining the capabilities of the gesture-level model (GLM) and heuristic evaluation to assess the usability of mobile apps in early stages of the design cycle and without the need for costly and time-consuming user testing. The approach can be run on a graphical user interface and includes uncertainties regarding user skill level and distraction. Preliminary results suggested that this approach can be used for usability evaluation of mobile apps; however, its validity and generalizability to other domains need to be validated in the future with human-subject experiments.

Get full access to this article

View all access options for this article.

References

Baker

(2004). Simplicity. https://stanford.library.sydney.edu.au/archives/spr2017/entries/simplicity/. Access date: Mar 1, 2021.

Beatty

A. L.

Magnusson

S. L.

Fortney

J. C.

Sayre

G. G.

Whooley

M. A

. (2018). VA FitHeart, a mobile app for cardiac rehabilitation: usability study. JMIR human factors, 5(1), e3.

Bevan

(1998). ISO 9241: Ergonomic requirements for office work with visual display terminals (VDTs)-Part 11: Guidance on usability. Tc, 159, 61.

Brooke

(1996). Sus: a “quick and dirty’usability. Usability evaluation in industry, 189.

Businge

Openja

Kavaler

Bainomugisha

Khomh

Filkov

. (2019). Studying android app popularity by cross-linking github and google play store. Paper presented at the 2019 IEEE 26th International Conference on Software Analysis, Evolution and Reengineering (SANER).

Cao

(2018). Modeling and predicting mobile phone touchscreen transcription typing using an integrated cognitive architecture. International Journal of Human–Computer Interaction, 34(6), 544–556.

Cao

Liu

(2014). Modeling driving and sentence comprehension dual-task performance in Queueing Network-ACTR. Paper presented at the proceedings of the human factors and ergonomics society annual meeting.

Card

Moran

Newell . (1980). Computer text-editing: An information-processing analysis of a routine cognitive skill. Cognitive psychology, 12(1), 32–74.

Card

Moran

Newell . (1986). The model human processor- An engineering model of human performance. Handbook of perception and human performance., 2(45–1).

10.

Clement

(2020). Number of apps available in leading app stores 2020: Statista.

11.

Da Costa

R. P.

Canedo

E. D.

De Sousa

R. T.

Albuquerque

R. D. O.

Villalba

L. J. G

. (2019). Set of usability heuristics for quality assessment of mobile applications on smartphones. IEEE Access, 7, 116145–116161.

12.

Din

(2015). Usable Security using GOMS: A Study to Evaluate and Compare the Usability of User Accounts on E-Government Websites.

13.

Dubey

S. K.

Gulati

(2012). Usability evaluation of software systems using fuzzy multi-criteria approach.

14.

Ehrler

Weinhold

Joe

Lovis

Blondon

(2018). A mobile app (BEDSide Mobility) to support nurses’ tasks at the patient’s bedside: usability study. JMIR mHealth and uHealth, 6(3), e57.

15.

Estes

(2017). Cogulator. The MITRE Corporation, 2017. [Online]. Available: http://cogulator.io.

16.

Fitts

P. M.

(1954). The information capacity of the human motor system in controlling the amplitude of movement. Journal of experimental psychology, 47(6), 381.

17.

Gerhardt-Powals

(1996). Cognitive engineering principles for enhancing human-computer performance. International Journal of Human-Computer Interaction, 8(2), 189–211.

18.

Granollers

(2018). Usability Evaluation with Heuristics, Beyond Nielsen’s List. Paper presented at the The Eleventh International Conference on Advances in Computer-Human Interactions (ACHI 2018).

19.

Harrison

Flood

Duce

(2013). Usability of mobile applications: literature review and rationale for a new usability model. Journal of Interaction Science, 1(1), 1–16.

20.

Hermawati

Lawson

(2016). Establishing usability heuristics for heuristics evaluation in a specific domain: Is there a consensus? Applied ergonomics, 56, 34–51.

21.

Hick

W. E.

(1952). On the rate of gain of information. Quarterly Journal of experimental psychology, 4(1), 11–26.

22.

Holleis

Otto

Hussmann

Schmidt

(2007). Keystroke-level model for advanced mobile phone interaction. Paper presented at the Proceedings of the SIGCHI Conference on Human Factors in Computing Systems.

23.

Hyman

(1953). Stimulus information as a determinant of reaction time. Journal of experimental psychology, 45(3), 188.

24.

Jeong

. (2018). Computational Modeling and Experimental Research on Touchscreen Gestures, Audio/Speech Interaction, and Driving.

25.

Jeong

Liu

. (2016). Computational Modeling of Finger Swipe Gestures on Touchscreen: Application of Fitts’ Law in 3D Space. Paper presented at the Proceedings of the Human Factors and Ergonomics Society Annual Meeting.

26.

Jeong

Liu

(2019). Computational modeling of touchscreen drag gestures using a cognitive architecture and motion tracking. International Journal of Human–Computer Interaction, 35(6), 510–520.

27.

John

B. E.

Gray

W. D.

(1995). CPM-GOMS: an analysis method for tasks with parallel activities. Paper presented at the Conference companion on Human factors in computing systems.

28.

Jung

Jang

(2015). Development of a two-step touch method for website navigation on smartphones. Applied ergonomics, 48, 148 153.

29.

Kim

Myung

(2016). A Unit Touch Gesture Model of Performance Time Prediction for Mobile Devices. J Ergon Soc Korea, 35(4), 277–291.

30.

Liu

Feyen

Tsimhoni

(2006). Queueing Network-Model Human Processor (QN-MHP) A computational architecture for multitask performance in human-machine systems. ACM Transactions on Computer-Human Interaction (TOCHI), 13(1), 37–70.

31.

Mohamed

Yusoff

Jaafar

(2012). Quantitive analysis in a heuristic evaluation for usability of educational computer game (UsaECG). Paper presented at the 2012 International Conference on Information Retrieval & Knowledge Management.

32.

Morgan

M. G.

Henrion

Small

(1990). Uncertainty: a guide to dealing with uncertainty in quantitative risk and policy analysis: Cambridge university press.

33.

Nayebi

Desharnais

J.-M.

Abran

(2012). The state of the art of mobile application usability evaluation. Paper presented at the 2012 25th IEEE Canadian Conference on Electrical and Computer Engineering (CCECE).

34.

Nayebi

Desharnais

J.-M.

Abran

(2013). An expert-based framework for evaluating ios application usability. Paper presented at the 2013 Joint Conference of the 23rd International Workshop on Software Measurement and the 8th International Conference on Software Process and Product Measurement.

35.

Nielsen

(1994). Usability engineering: Morgan Kaufmann.

36.

Nielsen

(2005). Ten usability heuristics.

37.

Nielsen

Landauer

T. K.

(1993). A mathematical model of the finding of usability problems. Paper presented at the Proceedings of the INTERACT’93 and CHI’93 conference on Human factors in computing systems.

38.

Nyström

(2018). Gesture-level model: A modified Keystroke-level model for tasks on mobile touchscreen devices.

39.

Prahara

Saputro

T. S.

(2019). Keystroke-Level Model to Evaluate Chatbot Interface for Reservation System. Paper presented at the 2019 6th International Conference on Electrical Engineering, Computer Science and Informatics (EECSI).

40.

Quiñones

Rusu

(2017). How to develop usability heuristics: A systematic literature review. Computer standards & interfaces, 53, 89–122.

41.

Rebai

Maalej

M. A.

Mahfoudhi

Abid

(2016). Building and evaluating an adaptive user interface using a Bayesian network approach. International Journal of Computer Science and Information Security, 14(7), 548.

42.

Salazar

L. H. A.

Lacerda

Nunes

J. V.

von Wangenheim

C. G.

(2013). A systematic literature review on usability heuristics for mobile phones. International Journal of Mobile Human Computer Interaction (IJMHCI), 5(2), 50–61.

43.

Sauro

Kindlund

(2005). A method to standardize usability metrics into a single score. Paper presented at the Proceedings of the SIGCHI conference on Human factors in computing systems.

44.

Shneiderman

Plaisant

(2010). Designing the user interface: Strategies for effective human-computer interaction: Pearson Education India.

45.

Weinschenk

Barker

D. T.

(2000). Designing effective speech interfaces: John Wiley & Sons, Inc.

46.

Zhang

(2017). Learn to Integrate Mathematical Models in Human Performance Modeling. Paper presented at the Proceedings of the Human Factors and Ergonomics Society Annual Meeting.