Software usability should be scaled in terms of the probability that a user interface will meet established usability requirements. This paper describes a scaling procedure that first estimates the distribution of common usability metrics and then calculates the probability that a user interface will meet a specific requirement. A series of Monte Carlo simulations showed that even with a small sample of usability test participants, the scaling procedure remained unbiased and could accurately differentiate usable from unusable user interfaces.
Get full access to this article
View all access options for this article.
References
1.
CraigA. (1979). Nonparametric measures of sensory efficiency for sustained monitoring tasks. Human Factors, 21, 69–78.
2.
FaulknerL. (2003). Beyond the five-user assumption: Benefits of increased sample sizes in usability testing. Behavior Research Methods, Instruments & Computers, 35(3), 379–383.
3.
FrackerM. L.HeckHGoeschelG. (2010). When a user interface is good enough: User ratings in UI design. Proceedings of the 54th Annual Meeting of the Human Factors Society. Santa Monica, CA. Human Factors Society.
4.
HoggR. V.CraigA. T. (1978). Introduction to mathematical statistics (4th ed). New York: Macmillan.
5.
LewisJ. R. (2000). Evaluation of procedures for adjusting problem-discovery rates estimated from small samples. International Journal of Human–Computer Interaction, 13(4), 445–479.
6.
MacMillanN. A.CreelmanC. D. (1990). Response bias: Characteristics of detection theory, threshold theory, and “nonparametric” indexes. Psychological Bulletin, 107, 401–413.
7.
NielsonJ. (1993). Usability Engineering. New York: AP.
8.
NielsonJ.MackR. L. (1994). Usability inspection methods. New York: Wiley.
9.
PollackI.NormanD. A. (1964). A nonparametric analysis of recognition experiments. Psychonomic Science, 1, 125–126.
10.
TaylorH.KarlinS. (1984). An introduction to stochastic modeling. New York: Academic Press.
11.
WickensC. D. (1984). Engineering psychology and human performance. Columbus, OH: Merril.
