Using the Analytic Hierarchical Process to Create a Single Usability Score for Website Interfaces

Abstract

We propose a new approach to create a single score metric to compare and rank the usability of website interfaces. The approach is based on the Analytic Hierarchy Process. We built the model and validated it using four usability studies, two of which are on a manufacturing firm website and the other two are on a service firm website. The results revealed a difference in domain between manufacturing and service. Still, this approach to creating a single score for usability is new in the literature for website evaluation and can help explain the ranking of website interfaces to non-experts. This is especially true for clients with the need to repeat website evaluations yearly or with clients who need a comparative analysis for their website against others in the same business. Future research is necessary to develop this approach further and validate it using a more comprehensive data set from an identical domain.

Get full access to this article

View all access options for this article.

References

Babiker

E.M.

Fujihara

Boyle

Craig D. B.

(1991). A metric for hypertext usability. In Proc. 11th Annual International Conference on Systems documentation, (pp.95–104). ACM Press.

Brooke

(1996). SUS - A quick and dirty usability scale. In Jordan

P. W.

Thomas

Weerdmeester

B. A.

McClelland

I. L.

(eds) Usability evaluation in industry, (London: Taylor & Francis), pp. 189–194.

Mitta

D.A.

(1993). An application of the analytic hierarchy process: A rank-ordering of computer interfaces. In Proc. 35^th Annual Meeting of the Human Factors and Ergonomics Society.

Quesenbery

(2003). “The Five Dimensions of Usability.” In Stone

Jarrett

Woodroffe

Minocha

(2005) User Interface Design and Evaluation. San Francisco, CA: Morgan Kaufmann Publishers.

Ryu

S.Y.

Reeves

Jackson

T. L.

Nussbaum

M. A.

(2007). Decision Models for Comparative Usability Evaluation of Mobile Phones Using the Mobile Phone Usability Questionnaire (MPUQ). Journal of Usability Studies, vol. 3.1, pp. 24–40.

Saaty

T.L.

(1977). A Scaling Method for Priorities in Hierarchical Structures. Journal of Mathematical Psychology, vol. 15, pp. 234–281.

Sauro

Kindlund

(2005). “A Method to Standardize Usability Metrics into a Single Score.” CHI 2005 (pp 401–409). Portland, OR.

Winston

Albright

(2001). Practical Management Science. Duxbury, Thomson Learning.