Convergent Usability Evaluation of the HFES Website

Abstract

The purpose of this usability analysis was to utilize convergent methods to evaluate the Human Factors and Ergonomics Society (HFES) website and provide recommendations to improve user experience. Three methods were utilized including the Mouloua and Alberti Usability Questionnaire (MAUQ), the System Usability Scale (SUS), and Net Promoter Score (NPS). An in-depth heuristic analysis using Nielsen's 10 Usability Heuristics was conducted in concordance with the previous scales to provide specific implementation recommendations for improving user experience. Our findings suggest that implementing convergent methods leads to robust knowledge about the user experience of a digital product. Both theoretical and practical implications are discussed, alongside recommendations for design improvements, and directions for future research are presented.

Get full access to this article

View all access options for this article.

References

Bias

R. G.

Mayhew

D. J.

(Eds.). (2005). Cost-Justifying Usability: An Update for the Internet Age (2nd ed.). Morgan Kaufmann.

Brooke

(1996). SUS - A quick and dirty usability scale. In Jordan

P. W.

Thomas

Weerdmeester

B. A.

McClelland

A. L.

, (Eds.), Usability Evaluation in Industry Taylor and Francis.

Brooke

(2013). SUS: A retrospective. Journal of Usability Studies, 8(2), 29-40.

Fok

A. W.

Procci

Flynn

J. R.

Mouloua

(2013). The effects of mental model conformity on usability in apps. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 57(1), 13231327. https://doi.org/10.1177/1541931213571292

Ford

Schotz

Montalvo

(2021) Individuation based usability of a customized e-commerce platform. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 65(1), 908-912. https://doi.org/10.1177/1071181321651306

Human Factors | Ergonomics Society. (2020, September 25). Human factors and ergonomics society (HFES) announces new brand including refreshed mission, vision, logo, tagline, and website. Newswise. https://www.newswise.com/articles/human-factors-and-ergonomics-society-hfes-announces-new-brand-including-refreshed-mission-vision-logo-tagline-and-website

Human Factors | Ergonomics Society. (2022). Homepage [screen capture]. Retrieved from https://www.hfes.org

Keiningham

T. L.

Aksoy

Cooil

Andreassen

T. W.

Williams

(2008). A holistic examination of Net Promoter. Database Marketing & Customer Strategy Management, 15(2), 79-90. https://doi.org/10.1057/dbm.2008.4

Kortum

P. T.

Bangor

(2013). Usability ratings for everyday products measured with the System Usability Scale. International Journal for Human-Computer Interaction, 29(2), 67-76. https://doi.org/https://doi.org/10.1080/10447318.2012.681221

10.

Lund

A. M.

(2001). Measuring usability with the USE questionnaire. Usability interface, 8(2), 3-6.

11.

Nielsen

(1994). Enhancing the explanatory power of usability heuristics. CHI '94: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 152-158. https://doi.Org/https://doi.org/10.1145/191666.191729

12.

Nielsen

Levy

(1994). Measuring usability: preference vs. performance. Communications of the ACM, 37(4), 66-75. https://doi.org/10.1145/175276.175282

13.

Nielsen

Mack

R. L.

(Eds.) (1994). Usability inspection methods. New York NY: John Wiley & Sons.

14.

Nielsen

, (2010). What is Usability? In Wilson

(Ed.), User Experience Re-Mastered (pp. 3-22). Morgan Kaufmann.

15.

Nielsen

Berger

J. M.

Gilutz

Whitenton

(2013). Return on Investment (ROI) for Usability.

16.

Nielsen

(2020). 10 Usability Heuristics for User Interface Design. https://www.nngroup.com/articles/ten-usability-heuristics/

17.

Reichheld

F. F.

(2003). The one number you need to grow. Harvard business review, 81(12), 46-55.

18.

Rivera

Davis

Mouloua

Alberti

. (2010). Usability evaluation of two social networking sites. Proceedings of the Human Factors and Ergonomics Society 54th Annual Meeting, 54(19), 1421-1424. https://doi.org/10.1177/154193121005401914

19.

Sasmito

G. W.

Zulfiqar

L. O. M.

Nishom

(2019). Usability testing based on System Usability Scale and Net Promoter Score. 2019 International Seminar on Research of Information Technology and Intelligent Systems (ISRITI), 540-545. https://doi.org/10.1109/ISRITI48646.2019.9034666