Objective: For three different system categories—fabricated artifacts, built environments, and software interfaces, to compare and contrast observer rankings of the overall quality of a selected topic or artifact pertaining to that category, relative to rankings of the quality of different specific attributes of the same topic. Method: A paired samples t-test was applied to ascertain the degree of statistical similarity between the overall quality rankings, and the average specific attribute quality rankings. Result: For each of the three system categories, the grouped average for overall quality rankings is higher than the grouped average for averaged specific attribute quality rankings. Conclusion: Two alternative interpretations of the results are offered, informed by either Gestalt psychology or by neurobiological reference to cognitive versus affective decision-making. Understanding of the basis of the findings will require further research. Application: Usability analysis assumes that evaluating the quality of specific attributes of a selected design will predict overall design quality. It can be argued that findings reported here call into question widely accepted assumptions about the general utility of usability analysis.
Get full access to this article
View all access options for this article.
References
1.
BilaliḉM.McLeodP. (2014). Why good thoughts block better ones. Scientific American (March), 310(3), 74-79.
GouldJ.D. (1988). How to design usable systems. In HelanderM. (Ed.), Handbook of Human-Computer Interaction (Chap. 35, pp. 757-789). Amsterdam: Elsevier.
4.
HarrisS. (2012). Free will. New York: Free Press.
5.
KahnemanD. (2011). Thinking fast and slow. New York: Farrar, Straus and Giroux.
6.
KaufmanM.T.ChurchlandA.K. (2013). Sensory noise drives bad decisions. Nature, 49(7444), 172-173.
7.
LeamanA.BordassB. (1999). Productivity in buildings: the ‘killer variables. Building Research & Information, 27(1), 4-19
8.
NormanD.A. (1988). The psychology of everyday things. New York: Basic Books.
9.
MandelT. (1997). The elements of user interface design. New York: Wiley.
10.
SchafferE. (2008). Beyond usability. Designing for persuasion, emotion, and trust. Fairfield, IA: Human Factors International White Paper.
11.
ShneidermanB. (1998). Designing the user interface. Strategies for effective human-computer interaction (3rd Ed.). Reading, MA: Addison-Wesley.
12.
SmithB. (Ed.) (1988). Foundations of gestalt theory. Munich and Vienna: Philosophia Verlag.
13.
SPSS Inc. (1997). SPSS Professional Statistics7.5. Chicago, IL: SPSS Inc.
14.
VischerJ.C. (1989). Environmental quality in offices. New York: Van Nostrand Reinhold.
15.
WangE.CaldwellB. (2002). An empirical study of usability testing: heuristic evaluation vs. user testing. In Proceedings of the Human Factors and Ergonomics Society 46th Annual Meeting (774-778). Santa Monica, CA: Human Factors and Ergonomics Society.
