The Need Fora Standardized Set of Usability Metrics

Abstract

A critical problem for the advancement of our discipline is the lack of consensus about metrics for measuring the dimensions of usability. What matters to users and to those who want users to adopt a system or product is usability from the users' perspective, and what should matter to designers and researchers is the question of what influences that perspective. Solving this problem would add structure to research on user interface methodologies and new design techniques. It would allow the research to be integrated more effectively. It would provide a way for industry to assess when the benefits of applying the results from the lab are justified by the cost, and it would support the creation of more useful guidance for the practitioner on when to apply new methodologies and techniques.

Get full access to this article

View all access options for this article.

References

Adams

D. A.

Nelson

R. R.

Todd

P. A.

(1992). Perceived usefulness, ease of use, and usage of information technology: A replication. MIS Quarterly, 16(2), 227–247.

Bailey

R. W.

(1995). Performance vs. preference. In Perlman

Green

G. K.

Wogalter

M. S.

, Human Factors Perspectives on Human-Computer Interaction: Selections from Proceedings of Human Factors and Ergonomics Society Annual Meetings 1983–1994 (pp. 316–320). Santa Monica, CA: Human Factors and Ergonomics Society.

Bittner

A. C.

(1990). Human factors measurement: Nature, problems, and strengthening. In Proceedings of the Human Factors Society 34th Annual Meeting (pp. 1253–1257). Santa Monica, CA: Human Factors and Ergonomics Society.

Chin

J. P.

Diehl

V. A.

Norman

K. L.

(1988). Development of an instrument measuring user satisfaction of the human-computer interface. In Proceedings of SIGCHI '88 (pp. 213–218). New York: ACM/SIGCHI.

Davis

F. D.

(1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, September, 319–340.

Kantowitz

B. H.

(1990). Can cognitive theory guide human factors measurement? In Proceedings of the Human Factors Society 34th Annual Meeting (pp. 1258–1262). Santa Monica, CA: Human Factors and Ergonomics Society.

Kirakowski

Corbett

(1993). SUMI: The Software Usability Measurement Inventory. British Journal of Education Technology, 24(3), 210–212.

Lund

A. M.

(1994). Navigating on the information highway. In Proceedings of the Human Factors Society 38th Annual Meeting. Santa Monica, CA: Human Factors and Ergonomics Society.

Lund

A. M.

(in press). Damaged merchandise? Comments on shopping at outlet malls. Human-Computer Interaction.

10.

Meister

Enderwick

Bittner

Kantowitz

(1990). Overview human factors measurement: The challenge. In Proceedings of the Human Factors Society 34th Annual Meeting (pp. 1241–1242). Santa Monica, CA: Human Factors and Ergonomics Society.

11.

Meister

(1991). The epistemological basis of human factors research and practice. In Proceedings of the Human Factors Society 35th Annual Meeting (pp. 1275–1279). Santa Monica, CA: Human Factors and Ergonomics Society.

12.

Moore

G. C.

Benbasat

(1991). Development of an instrument to measure the perceptions of adopting an information technology innovation. Information Systems Research, 2(3), 192–222.

13.

Morris

M. G.

Dillon

(1997). How user perceptions influence software use. IEEE Software, 14(4), 58–65.

14.

Schwartz

A. L.

Seifert

(1996). Can a usable product flash 12:00?: Perceived usability as a function of usefulness. In Proceedings of the Human Factors Society 40th Annual Meeting (pp. 313–317). Santa Monica, CA: Human Factors and Ergonomics Society.