Configural Display Design Techniques Considered at Multiple Levels of Evaluation

Abstract

Two studies were conducted to examine issues in the design and evaluation of configural displays. Four design techniques (bar graphs/extenders, scale markers/ scale grids, color coding/color layering/color separation, and annotation with digital values) were applied, alone and in combination, to a baseline configural display, forming 10 displays. Two qualitatively different evaluations assessed performance for (A) low-level data probes (quantitative estimates of individual variables) and (B) system control and fault detection tasks. Three of the four design techniques improved performance significantly for low-level data probes (color coding was the exception). A display with digital values only (i.e., no analog configural display) produced the poorest performance for control/fault detection tasks. When both levels of evaluation are considered, a composite display (configural display with all four techniques applied) was clearly the most effective. Overall, the findings obtained in the two experiments provide very limited evidence for the generalization of results between evaluations. The two levels of evaluation, the display manipulations, and the patterns of results are considered in terms of a cognitive systems engineering evaluation framework. General implications for the evaluation of displays and interfaces are discussed. Actual or potential applications include design techniques to improve graphical displays and methodological insights to focus and improve evaluation efforts.

Get full access to this article

View all access options for this article.

References

Bennett, K. B. , & Flach, J. M. (1992). Graphical displays: Implications for divided attention, focused attention, and problem solving. Human Factors, 34, 513-533.

Bennett, K. B. , Nagy, A. L. , & Flach, J. M. (1997). Visual displays. In G. Salvendy (Ed.), Handbook of human factors and ergonomics (2nd ed., pp. 659-696). New York: Wiley.

Bennett, K. B. , Payne, M. , Calcaterra, J. , & Nittoli, B. (2000). An empirical comparison of alternative methodologies for the evaluation of configural displays. Human Factors, 42, 287-298.

Bennett, K. B. , Toms, M. L. , & Woods, D. D. (1993). Emergent features and configural elements: Designing more effective configural displays. Human Factors, 35, 71-97.

Hansen, J. P. (1995). An experimental investigation of configural, digital, and temporal information on process displays. Human Factors, 37, 539-552.

Keppel, G. (1982). Design and analysis. A researcher's handbook (2nd ed.). Englewood Cliffs, NJ: Prentice-Hall.

Lovie, P. (1986). Identifying outliers. In A. D. Lovie (Ed.), New developments in statistics for psychology and the social sciences (pp. 44-69). London: British Psychological Society and Methuen.

Moray, N. , Lootsteen, P. , & Pajak, J. (1986). Acquisition of process control skills. IEEE Transactions on Systems, Man and Cybernetics, SMC-16, 497-504.

Poulton, E. C. (1974). Tracking skill and manual control. New York: Academic.

10.

Rasmussen, J. , Pejtersen, A. M. , & Goodstein, L. P. (1994). Cognitive systems engineering. New York: Wiley.

11.

Roth, E. M. , Woods, D. D. , & Gallagher, J. M., Jr. (1986). Analysis of expertise in a dynamic control task. In Proceedings of the Human Factors Society 30th Annual Meeting (pp. 179-182). Santa Monica, CA: Human Factors and Ergonomics Society.

12.

Sanderson, P. , Verhag, A. G. , & Fuld, R. B. (1989). State-space and verbal protocol methods for studying the human operator in process control. Ergonomics, 32, 1343-1372.

13.

Vicente, K. J. (1991). Supporting knowledge based behavior through ecological interface design (Tech. Report EPRL-91-1). Urbana-Champaign: University of Illinois, Engineering Psychology Research Laboratory and Aviation Research Laboratory.

14.

Vicente, K. J. (1997). Heeding the legacy of Meister, Brunswik, and Gibson: Toward a broader view of human factors research. Human Factors, 39, 323-328.

15.

Wickens, C. D. , & Carswell, C. M. (1995). The proximity compatibility principle: Its psychological foundation and relevance to display design. Human Factors, 37, 473-494.

16.

Yu, X. , Lau, E. , Vicente, K. J. , & Carter, M. W. (1998). Advancing performance measurement in cognitive engineering: The abstraction hierarchy as a framework for dynamical systems analysis. In Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting (pp. 359-363). Santa Monica, CA: Human Factors and Ergonomics Society.